Add wandb logs post-training

wandb/run-20220828_085247-2hx8pk65/files/config.yaml

@@ -19,6 +19,16 @@ _wandb:
       - 49
       - 51
       - 55
+      2:
+      - 1
+      - 5
+      - 11
+      - 12
+      - 45
+      - 49
+      - 51
+      - 53
+      - 55
       3:
       - 13
       4: 3.8.10

wandb/run-20220828_085247-2hx8pk65/files/media/table/eval/step_50k_50000_d946277550bdcac4712f.table.json

@@ -0,0 +1 @@
+{"columns": ["id", "label_str", "beam_1", "beam_2", "beam_3", "beam_4", "beam_5"], "data": [["2277-149896-0000", "he was in a fevered state of mind owing to the blight his wife's action threatened to cast upon his entire future", "he was in a fevered state of mind owing to the blight his wife's action threatened to cast upon his entire future", "he was in a fevered state of mind owing to the blight his wife's action threatened to cast upon his entire future", "he was in a fevered state of mind owing to the blight his wife's action threatn'd to cast upon his entire future", "he was in a feathered state of mind owing to the blight his wife's action threatened to cast upon his entire future", "he was in a fevered state of mind owing to the blight his wife's action threatened cast upon his entire future"], ["2277-149896-0001", "he would have to pay her the money which she would now regularly demand or there would be trouble it did not matter what he did", "he would have to pay her the money which she would now regularly demand or there would be trouble it did not matter what he did", "he would have to pay her the money which she would now regularly demand or there would be trouble it did not matter what he did it", "he would have to pay her the money which she would now regularly demand or there would be trouble it did not matter what he did'", "he would have to pay her the money which she would now regularly demand or there would be trouble it did not matter what he said", "he would have to pay her her the money which she would now regularly demand or there would be trouble it did not matter what he did"], ["2277-149896-0002", "hurstwood walked the floor mentally arranging the chief points of his situation", "hurstwood walked the floor mentally arranging the chief points of his situation", "hurstwood walked to the floor mentally arranging the chief points of his situation", "whistwood walked the floor mentally arranging the chief points of his situation", "whilstwood walked the floor mentally arranging the chief points of his situation", "hurstwood walked the floor mentally arranging the chief points in his situation"], ["2277-149896-0003", "he also thought of his managerial position", "he also thought of his managerial position", "he also thought of this managerial position", "he also thought of his managemental position", "he also thought of his mathematical position", "he also thought of the managerial position"], ["2277-149896-0004", "how would the papers talk about it", "how would the papers talk about it", "how would the papers talk about it you", "how would the papers talk about it and", "how would the papers talk about it would", "how would the papers talk about it he"], ["2277-149896-0005", "many little wrinkles gathered between his eyes as he contemplated this and his brow moistened", "many little wrinkles gathered between his eyes as he contemplated this and his brow moistened", "many little wrinkles gathered between his eyes as he considered this and his brow moistened", "many little wrinkles gathering between his eyes as he contemplated this and his brow moistened", "many little wrinkles gathered between his eyes as he contemplated this this and his brow moistened", "many little wrinkles gathered between his eyes as he contemplated this then his brow moistened"], ["2277-149896-0006", "he could arrange that satisfactorily for carrie would be glad to wait if necessary", "he could arrange that satisfactorily for carrie would be glad to wait if necessary", "he could arrange that satisfactorily for carry would be glad to wait if necessary", "he could arrange that satisfactorily for kay would be glad to wait if necessary", "he could arrange that satisfactorily for cary would be glad to wait if necessary", "he could arrange that satisfactorily for carey would be glad to wait if necessary"], ["2277-149896-0007", "he would see how things turned out to morrow and then he would talk to her they were going to meet as usual", "he would see how things turned out tomorrow and then he would talk to her they were going to meet as usual", "he would see how things turned out today and then he would talk to her they were going to meet as usual", "", "", ""], ["2277-149896-0008", "for some reason he felt as if something might come that way and was relieved when all the envelopes had been scanned and nothing suspicious noticed", "for some reason he felt as if something might come that way and was relieved when all the envelopes had been scanned and nothing suspicious noticed", "for some reason he felt as if something might come that way and was relieved while all the envelopes had been scanned and nothing suspicious noticed", "for some reason he felt as if something might come that way and was relieved when all the envelopes had been sketched and nothing suspicious noticed", "for some reason he felt as if something might come that way and was relieved when all the envelopes had been screened and nothing suspicious noticed", "for some reason he felt as if something might come that way and was relieved when all the envelopes had been scanned and nothing suspicious notice"], ["2277-149896-0009", "while the danger had not lessened it had not as yet materialised and with him no news was good news", "while the danger had not lessened it had not as yet materialized and with him no news was good news", "while the danger had not lessened it had not as yet materialised and with him no news was good news", "while the danger had not loosened it had not as yet materialized and with him no news was good news", "while the danger had not lessened it had not as yet materialized and with him no news was good news and", "while the danger had not lessen'd it had not as yet materialized and with him no news was good news"], ["2277-149896-0010", "so little did he consider drouet that it never once occurred to him to worry about his finding out", "so little did he consider drouet that it never once occurred to him to worry about his finding out", "so little did he consider drue that it never once occurred to him to worry about his finding out", "so little did he consider drua that it never once occurred to him to worry about his finding out", "so little did he consider druah that it never once occurred to him to worry about his finding out", "so little did he consider dru that it never once occurred to him to worry about his finding out"], ["2277-149896-0011", "he grew restless as he ruminated and then decided that perhaps it was nothing", "he grew restless as he ruminated and then decided that perhaps it was nothing", "he grew restless as he ruminated and then decided that perhaps it was nothing", "he grew restless as he ruminated and then decide that perhaps it was nothing", "he grew restless as he ruminated and then deciding that perhaps it was nothing", "he grew restless as heruminated and then decided that perhaps it was nothing"], ["2277-149896-0012", "she had not been able to get away this morning", "she had not been able to get away this morning", "she had not been able to get away this morning and", "she had not been able to get away this morning i", "she had not been able to get away this morning it", "she had not been able to get away this morning a"], ["2277-149896-0013", "he would get one to day it would probably be on his desk when he got back he would look for it at once", "he would get one to day it would probably be on his desk when he got back he would look for it at once", "he would get one to day it would probably be on his desk when he got back he would look for it at once and", "he would get one to day it could probably be on his desk when he got back he would look for it at once", "he would get one to day it would probably be upon his desk when he got back he would look for it at once", "he would get one to day it would probably be on his desk when we got back he would look for it at once"], ["2277-149896-0014", "after a time he gave up waiting and drearily headed for the madison car", "after a time he gave up waiting and drearily headed for the madison car", "after a time he gave up waiting and drearily heading for the madison car", "after a time he gave up waiting and rearily headed for the madison car", "after a time he gave up waiting and desirily headed for the madison car", "after a time he gave up waiting and drearily headed for the mattison car"], ["2277-149896-0015", "he went in and examined his letters but there was nothing from carrie", "he went in and examined his letters but there was nothing from carrie", "he went in and examined his letters but there was nothing from carry", "he went in and examined his letters but there was nothing from kerry", "he went in and examined his letters but there was nothing from perry", "he went in and examined his letters but there was nothing from carey"], ["2277-149896-0016", "fortunately there was nothing from his wife either", "fortunately there was nothing from his wife either", "fortunately there was nothing from his wife either", "fortunally there was nothing from his wife either", " fortunately there was nothing from his wife either", "finally there was nothing from his wife either"], ["2277-149896-0017", "at one thirty he went to rector's for lunch and when he returned a messenger was waiting for him", "at one thirty he went to rector's for lunch and when he returned a messenger was waiting for him", "at one thirty he went to rectors for lunch and when he returned a messenger was waiting for him", "at one thirty he went to rector's for lunch and when he returned a messenger was waiting for him", "at one thirty he went to restor's for lunch and when he returned a messenger was waiting for him", "at one thirty he went to rectors for lunch and when he returned a messenger was waiting for him"], ["2277-149896-0018", "his first impulse was to write but four words in reply go to the devil", "his first impulse was to write but four words in reply go to the devil", " his first impulse was to write but four words in reply go to the devil", "his first instinct was to write but four words in reply go to the devil", "his first impetus was to write but four words in reply go to the devil", "his first impulse was to write but four words in answer go to the devil"], ["2277-149896-0019", "but he compromised by telling the boy that there would be no reply", "but he compromised by telling the boy that there would be no reply", "but hecompromised by telling the boy that there would be no reply", "but he compromised by telling the boy there would be no reply", "but he compromised by telling the boy that there would be no reply i", "but he compromise by telling the boy that there would be no reply"], ["2277-149896-0020", "then he sat down in his chair and gazed without seeing contemplating the result of his work", "then he sat down in his chair and gazed without seeing contemplating the result of his work", "then he sat down in his chair and gazed without seeing contemplating the results of his work", "then he sate down in his chair and gazed without seeing contemplating the result of his work", "then he sat down in his chair and gazed without seeing contemplating the result of his works", "then he sat down in his chair and gazed without seeing contemplated the result of his work"], ["2277-149896-0021", "what would she do about that the confounded wretch", "what would she do about that the confounded wretch", "what would she do about that that confounded wretch", "what would she do about that the con founded wretch", "what could she do about that the confounded wretch", "what would she do about that the confounded wretch he"], ["2277-149896-0022", "later however his old discretion asserted itself", "later however his old discretion asserted itself", "later however his old discretion asserted itself and", "later however his old discretion asserted itself", " later however his old discretion asserted itself", "later however his old disregard asserted itself"], ["2277-149896-0023", "something had to be done a climax was near and she would not sit idle", "something had to be done a climax was near and she would not sit idle", "something had to be done a nexus was near and she would not sit idle", "everything had to be done a climax was near and she would not sit idle", "nothing had to be done a climax was near and she would not sit idle", "something had to be done a climax was near she would not sit idle"], ["2277-149896-0024", "he knew her well enough to know that when she had decided upon a plan she would follow it up", "he knew her well enough to know that when she had decided upon a plan she would follow it up", "he knew her well enough to know that when she had decide upon a plan she would follow it up", "he knew her well enough to know that when she had decided on a plan she would follow it up", "he knew her well enough to know that when she had decided upon a plans she would follow it up", "he knew her well enough to know that when she had decided upon the plan she would follow it up"], ["2277-149896-0025", "he arose from his chair and went and looked out into the street", "he arose from his chair and went and looked out into the street", "he arose from his chair and went and looked out into the streets", "he rose from his chair and went and looked out into the street", "he arose from his chair and went and looked out into the street and", "he arose from his chair and went and looking out into the street"], ["2277-149896-0026", "the long drizzle had begun pedestrians had turned up collars and trousers at the bottom", "the long drizzle had begun pedestrians had turned up collars and trousers at the bottom", "the long drizzle had begun pedestrians had turned up collars and trowsers at the bottom", "the long drizzle had begun pedestrians had turned up collars and trousers on the bottom", "the long drizzle had begun pedestrian had turned up collars and trousers at the bottom", "the long drizzle had begun vegetables had turned up collars and trousers at the bottom"], ["2277-149896-0027", "hurstwood almost exclaimed out loud at the insistency of this thing", "hurstwood almost exclaimed out loud at the insistence of this thing", "hurstwood almost exclaimed out loud at the insistency of this thing", "hurstwood almost exclaimed out loud at the insistency of this thing", "hurstwood almost exclaimed out loud at the insistence of this thing", "hurstwood almost exclaimed out loud at the insincerity of this thing"], ["2277-149896-0028", "he put on his hat and looked around for his umbrella", "he put on his hat and looked around for his umbrella", "he put on his hat and looked round for his umbrella", "he put on his hat and looked around for his umbrella and", "he put on his hat and looked about for his umbrella", "he put on his hat and looked toward for his umbrella"], ["2277-149896-0029", "he would have some arrangement of this thing", "he would have some arrangement of this thing", "he would have some arrangement of the thing", "he would have some arrangement of this thing and", "he would have some arrangement of the thing and", "he would have some arrangement of this thing that"], ["2277-149896-0030", "he began to wish that he had compromised in some way or other that he had sent the money perhaps he could do it up here", "he began to wish that he had compromised in some way or other that he had sent the money perhaps he could do it up here", "he began to wish that he had compromised in some way or other that he had sent the money perhaps he could do it up here and", "he began to wish that he had compromised in some way or other that he had sent the money perhaps he would do it up here", "he began to wish he had compromised in some way or other that he had sent the money perhaps he could do it up here", "he began to wish that he had compromised in some way or other that he had sented the money perhaps he could do it up here"], ["2277-149896-0031", "he would go in and see anyhow he would have no row", "he would go in and see anyhow he would have no row", "he would go in and see anyhow he would have no row he", "he would go in and see anyhow he would have no row he would", "he would go in and see anyhow he would have no row and", "he would go in and see anyhow he would have no row he'd"], ["2277-149896-0032", "by the time he reached his own street he was keenly alive to the difficulties of his situation and wished over and over that some solution would offer itself that he could see his way out", "by the time he reached his own street he was keenly alive to the difficulties of his situation and wished over and over that some solution would offer itself that he could see his way out", "by the time he reached his own street he was keenly alive to the difficulties of this situation and wished over and over that some solution would offer itself that he could see his way out", " by the time he reached his own street he was keenly alive to the difficulties of his situation and wished over and over that some solution would offer itself that he could see his way out", "by the time he reached his own street he was keenly alive to the troubles of his situation and wished over and over that some solution would offer itself that he could see his way out", ""], ["2277-149896-0033", "then he rang the bell no answer", "then he rang the bell no answer", "then he ranged the bell no answer", "then he rang a bell no answer", "then he rang the bell no answer i", "then he rang the bell no answer to"], ["2277-149896-0034", "he rang again this time harder still no answer", "he rang again this time harder still no answer", "he ring again this time harder still no answer", "he wrang again this time harder still no answer", "he rang again this time harder still no answer i", "he rang again this time longer still no answer"], ["2277-149897-0000", "when hurstwood got back to his office again he was in a greater quandary than ever", "when hurstwood got back to his office again he was in a greater quandary than ever", "when hurstwood got back to his office again he was in a greater quadrary than ever", "when hurstwood went back to his office again he was in a greater quandary than ever", "when hurstwood got back to his office again he was in a greater quadrille than ever", "when hurstwood got back to his office again he was in a greater dungeon than ever"], ["2277-149897-0001", "he could hardly realise how it had all come about", "he could hardly realize how it had all come about", "he could hardly realise how it had all come about", "he could hardly realize how it had all done about", "he could hardly realise how it had all come about", "he could hardly realize how it had all come about and"], ["2277-149897-0002", "no letter had come no word of any kind and yet here it was late in the evening and she had agreed to meet him that morning", "no letter had come no word of any kind and yet here it was late in the evening and she had agreed to meet him that morning", "no letter had come no word of any kind and yet here it was late in the afternoon and she had agreed to meet him that morning", "no letter had come no word of any kind and yet here it was late in the morning and she had agreed to meet him that morning", "no letter had come no word of any kind and yet here it was late in the evening as she had agreed to meet him that morning", "no letter had come no word of any kind and yet here it was late in the evening and she had agreed to met him that morning"], ["2277-149897-0003", "he saw that in the excitement of recent events he had not formulated a plan upon that score", "he saw that in the excitement of recent events he had not formulated a plan upon that score", "he saw that in the excitement of recent events he had not formulated a plan upon the score", "he saw that in the excitement of recent events he had not demonstrated a plan upon that score", "he saw that in the excitement of recent events he had not emphasized a plan upon that score", "he saw that in the excitement of recent events he had not originated a plan upon that score"], ["2277-149897-0004", "he was getting some vague comfort out of a good cigar but it was no panacea for the ill which affected him", "he was getting some vague comfort out of a good cigar but it was no panatia for the ill which affected him", "he was getting some vague comfort out of a good cigar but it was no panacea for the ill which affected him", "he was getting some vague comfort out of a good cigar but it was no panatism for the ill which affected him", "he was getting some vague comfort out of a good cigar but it was no penatia for the ill which affected him", "he was getting some vague comfort out of a good cigar but it was no panaty for the ill which affected him"], ["2277-149897-0005", "it was with great opposition after two or three hours of the most urgent mental affirmation and denial that at last he got an envelope placed in it the requested amount and slowly sealed it up", "it was with great opposition after two or three hours of the most urgent mental affirmation and denial that at last he got an envelope placed in it the requested amount and slowly sealed it up", "it was with great opposition after two or three hours of the most urgent personal affirmation and denial that at last he got an envelope placed in it the requested amount and slowly sealed it up", "it was with great opposition after two or three hours of the most urgent mental acknowledgement and denial that at last he got an envelope placed in it the requested amount and slowly sealed it up", "it was with great opposition after two or three hours of the most urgent mental acknowledgment and denial that at last he got an envelope placed in it the requested amount and slowly sealed it up", "it was with great opposition after two or three hours of the most urgent mental affirmation and denial that at last he got an envelope placed in it the required amount and slowly sealed it up"], ["2277-149897-0006", "then he called harry the boy of all work around the place", "then he called harry the boy of all work around the place", "then he called harry the boy of all work around the place and", "then he called harry the boy of all work around the place i", "then he called harry the boy of all work around the place had", "then he called harry the boy of all work around the place he"], ["2277-149897-0007", "you take this to this address he said handing him the envelope and give it to missus hurstwood yes sir said the boy", "you take this to this address he said handing him the envelope and give it to missus hurstwood yes sir said the boy", "you take this to this address he said handing him the envelope and give it to missus hurstwood yes sir said the boy i", "you take this to this address he said handing him the envelope and give it to missus hurstwood yes sir said the boy oh", "you take this to this address he said handing him the envelope and give it to missus hurstwood yes sir said the boy you", "you take this to this address he said handing him an envelope and give it to missus hurstwood yes sir said the boy"], ["2277-149897-0008", "any answer i guess not", "any answer i guess not", "any answer i guess not you", "any answer i guess notyou", "any answer i guess not he", "any answer i suspect not"], ["2277-149897-0009", "the boy hastened away and the manager fell to his musings", "the boy hastened away and the manager fell to his musings", "the boy hurried away and the manager fell to his musings", "the boy hastened away and the major fell to his musings", "the boy hastily away and the manager fell to his musings", "the boy hesitated away and the manager fell to his musings"], ["2277-149897-0010", "he was beaten for to night and he might just as well make the best of it", "he was beaten for to night and he might just as well make the best of it", "he was beaten for tonight and he might just as well make the best of it", "he was beaten for two night and he might just as well make the best of it", "he was beaten for no night and he might just as well make the best of it", "he was beaten for to night and he might just as well make best of it"], ["2277-149897-0011", "she would take the envelope and know that she had triumphed", "she would take the envelope and know that she had triumphed", "she would take the envelope and know that she had triumphed and", "she would take the envelope to know that she had triumphed", "she would take the envelope and know that she had triumphed eight", "she would take a envelope and know that she had triumphed"], ["2277-149897-0012", "if he only had that letter back he wouldn't send it", "if he only had that letter back he wouldn't send it", "if he only had that letter back he wouldn't send it", "if he only got that letter back he wouldn't send it", "if he only held that letter back he wouldn't send it", "if he only had that letter back he couldn't send it"], ["2277-149897-0013", "for relief he arose and joined in conversation with a few friends who were drinking", "for relief he arose and joined in the conversation with a few friends who were drinking", "for relief he arose and joined in the conversation with the few friends who were drinking", "for relief he arose and joined in the conversation with a few friends who were drinking and", "for relief he arose and rejoined in the conversation with a few friends who were drinking", "for relief he arose and joined in the conversation with a few friends who were drinking are"], ["2277-149897-0014", "all the time his thoughts would run out to his home and see the scene being therein enacted", "all the time his thoughts would run out to his home and see the scene being therein enacted", "all the time his thoughts would run out to his house and see the scene being therein enacted", "all the time his thoughts would run out to his home and see the scene being therein enacted", "all the time his thought would run out to his home and see the scene being therein enacted", "all the time his thoughts would run out to his home and see the scenes being therein enacted"]]}

wandb/run-20220828_085247-2hx8pk65/files/media/table/test.clean/step_50k_50000_d5fafb8dd177f43952e4.table.json

@@ -0,0 +1 @@
+{"columns": ["id", "label_str", "beam_1", "beam_2", "beam_3", "beam_4", "beam_5"], "data": [["6930-75918-0000", "concord returned to its place amidst the tents", "concord returned to its place amidst the tents", "conchord returned to its place amidst the tents", "conquord returned to its place amidst the tents", "concorn returned to its place amidst the tents", "concourse returned to its place amidst the tents"], ["6930-75918-0001", "the english forwarded to the french baskets of flowers of which they had made a plentiful provision to greet the arrival of the young princess the french in return invited the english to a supper which was to be given the next day", "the english forwarded to the french baskets of flowers of which they had made a plentiful provision to greet the arrival of the young princess the french in return invited the english to a supper which was to be given the next day", "the english forwarded to the french baskets of flowers of which they had made a plentiful provision to greet the arrival of the young princess the french in return invited the english to the supper which was to be given the next day", "the english forwarded to the french baskets of flowers of which they had made a plentiful provision to greet the arrival of the young princess the french in return invited the english to supper which was to be given the next day", "the english forwarded to the french baskets of flowers of which they had made a plentiful provision to greet the arrival of the young princess the french in return invited the english to a supper which was to be given the next day", "the english forwarded to the french baskets of flowers of which they had made a plentiful provision to greet the arrival of the young princess the french in return invited the english to a supper which was to be given the next day"], ["6930-75918-0002", "congratulations were poured in upon the princess everywhere during her journey", "congratulations were poured in upon the princess everywhere during her journey", "congratulations were poured in upon the princess everywhere during her journey", "congratulations were pouring in upon the princess everywhere during her journey", "congratulations were poured in upon the princess everywhere during her journeying", "congratulations were poured in upon the princess everywhere during her voyage"], ["6930-75918-0003", "from the respect paid her on all sides she seemed like a queen and from the adoration with which she was treated by two or three she appeared an object of worship the queen mother gave the french the most affectionate reception france was her native country and she had suffered too much unhappiness in england for england to have made her forget france", "from the respect paid her on all sides she seemed like a queen and from the adoration with which she was treated by two or three she appeared an object of worship france was her native country and she had suffered too much unhappiness in england for england to have made her forget france", "from the respect paid her on all signs she seemed like a queen and from the adoration with which she was treated by two or three she appeared an object of worship france was her native country and she had suffered too much unhappiness in england for england to have made her forget france", "from the respect paid her on all sides she seemed like a queen and from the adoration with which she was treated by two or three she appeared an object of worship france was her native country and she had suffered too much unhappiness in england for england to have made her forget france'", "from the respect paid her on all sides she seemed like a queen and from the adoration with which she was treated by two or three she appeared an object of worship france was her native country and she had suffered too much unhappiness in england for england to have made her forget france and", ""], ["6930-75918-0004", "she taught her daughter then by her own affection for it that love for a country where they had both been hospitably received and where a brilliant future opened before them", "she taught her daughter then by her own affection for it that love for a country where they had both been hospitably received and where a brilliant future opened for them", "she taught her daughter then by the own affection for it that love for a country where they had both been hospitably received and where a brilliant future opened for them", "she taught her daughter then by her own affection for it that love for a county where they had both been hospitably received and where a brilliant future opened for them", "she taught her daughter then by her own affection for it that love for a country where they had both been hospitably received and where a brilliant future opened for them they", "she taught her daughter then by her own affection for it that love for a country where they had both been hospitably received and where the brilliant future opened for them"], ["6930-75918-0005", "the count had thrown himself back on his seat leaning his shoulders against the partition of the tent and remained thus his face buried in his hands with heaving chest and restless limbs", "the count had thrown himself back on his seat leaning his shoulders against the partition of the tent and remained thus his face buried in his hands with heaving chest and restless limbs", "the count had thrown himself back on his seat leaning his shoulders against a partition of the tent and remained thus his face buried in his hands with heaving chest and restless limbs", "the count had thrown himself back on his seat leaning his shoulders against this partition of the tent and remained thus his face buried in his hands with heaving chest and restless limbs", "the count had thrown himself back on his seat leaning his shoulders against the partition of the tent and remained thus his face buried in his hands withheaving chest and restless limbs", "the count had thrown himself back on his seat leaning his shoulders against that partition of the tent and remained thus his face buried in his hands with heaving chest and restless limbs"], ["6930-75918-0006", "this has indeed been a harassing day continued the young man his eyes fixed upon his friend", "this has indeed been a harassing day continued the young man his eyes fixed upon his friend", "this has indeed been an harassing day continued the young man his eyes fixed upon his friend", "this has indeed been a harassing day continues the young man his eyes fixed upon his friend", "this has indeed been a harassing day continued the young man his eyes fixed on his friend", "this has indeed been a harassing day continued the young man his eye fixed upon his friend"], ["6930-75918-0007", "you will be frank with me i always am", "you will be frank with me i always am", "you will be frank with me i always am you", "you will be frank with me i always am all", "you will be frank with me i always am and", "you will be frank with me i always am you'll"], ["6930-75918-0008", "can you imagine why buckingham has been so violent i suspect", "can you imagine why buckingham has been so violent i suspect", " can you imagine why buckingham has been so violent i suspect", "can you imagine why buckingham had been so violent i suspect", "can you imagine why buckingham has been so violent i suspect you", "can you imagine why buckingham has been so vital i suspect"], ["6930-75918-0009", "it is you who are mistaken raoul i have read his distress in his eyes in his every gesture and action the whole day", "it is you who are mistaken raoul i have read his distress in his eyes in his every gesture and action the whole day", "it is you who are mistaken raoul i have read his distress in his eyes in his every gesture and action the whole day and", "it is you who are mistaken ruel i have read his distress in his eyes in his every gesture and action the whole day", "it is you who are mistaken rowel i have read his distress in his eyes in his every gesture and action the whole day", "it is you who are mistaken raoul i have read his distress in his eyes in his every gesture and action the whole day a"], ["6930-75918-0010", "i can perceive love clearly enough", "i can perceive love clearly enough", "i can perceive love clearly enough and", "i can perceive love plainly enough", "i can perceive love distinctly enough", "i can perceive love clearly enough to"], ["6930-75918-0011", "i am convinced of what i say said the count", "i am convinced of what i say said the count", "i am confident of what i say said the count", "i am convinced of what i say said the count i", "i am convinced of what i say says the count", "i am convinced of what i say said the count to"], ["6930-75918-0012", "it is annoyance then", "it is annoyance then", "it is annoyance then", "it is annoyance then i am tolivenance then you have so many of it is tolivenance then it is tolivenance then you are toliveness then and you are tok if you are tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome mousthen ye shallie tome it is tome it is invective then", "it is annoyance then i am tolivenance then you have so many of it is tolivenance then it is tolivenance then you are toliveness then and you are tok if you are tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome mousthen ye shallie tome it is tome it is tome it is", "it is annoyance then i am tolivenance then you have so many of it is tolivenance then it is tolivenance then you are toliveness then and you are tok if you are tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome it is tome mousthen ye shallie tome it is tome it is inveil ye"], ["6930-75918-0013", "in those very terms i even added more", "in those very terms i even added more", "in those very terms i even added more and", "in those very terms i even added more with", "in those very terms i even added more so", "in those very terms i even added more to"], ["6930-75918-0014", "but continued raoul not interrupted by this movement of his friend heaven be praised the french who are pronounced to be thoughtless and indiscreet reckless even are capable of bringing a calm and sound judgment to bear on matters of such high importance", "but continued rowell not interrupted by this movement of his friend heaven be praised the french who are pronounced to be thoughtless and indiscreet reckless even are capable of bringing a calm and sound judgment to bear on matters of such high importance", "but continued rowel not interrupted by this movement of his friend heaven be praised the french who are pronounced to be thoughtless and indiscreet reckless even are capable of bringing a calm and sound judgment to bear on matters of such high importance", "but continued rawle not interrupted by this movement of his friend heaven be praised the french who are pronounced to be thoughtless and indiscreet reckless even are capable of bringing a calm and sound judgment to bear on matters of such high importance", "but continued ruel not interrupted by this movement of his friend heaven be praised the french who are pronounced to be thoughtless and indiscreet reckless even are capable of bringing a calm and sound judgment to bear on matters of such high importance", "but continued raoul not interrupted by this movement of his friend heaven be praised the french who are pronounced to be thoughtless and indiscreet reckless even are capable of bringing a calm and sound judgment to bear on matters of such high importance"], ["6930-75918-0015", "thus it is that the honor of three is saved our country's our master's and our own", "thus it is that the honor of three is saved our country our masters and our own", "thus it is that the honour of three is saved our country our masters and our own", "thus it is that the honor of three is saved our country our masters and our own and", "thus it is that the honour of three is saved our country our masters and our own", "thus is that the honor of three is saved our country our masters and our own"], ["6930-75918-0016", "yes i need repose many things have agitated me to day both in mind and body when you return to morrow i shall no longer be the same man", "yes i need repose many things have agitated me today both in mind and body when you return to morrow i shall no longer be the same man", "yes i need repose many things have agitated me to day both in mind and body when you return to morrow i shall no longer be the same man", "yes i need repose many things have agitated me today both in mind and body when you return tomorrow i shall no longer be the same man", "yes i need repose many things have aggitated me today both in mind and body when you return to morrow i shall no longer be the same man", "yet i need repose many things have agitated me today both in mind and body when you return to morrow i shall no longer be the same man"], ["6930-75918-0017", "but in this friendly pressure raoul could detect the nervous agitation of a great internal conflict", "but in this friendly pressure raoul could detect the nervous agitation of a great internal conflict", "but in this friendly pressure raoul could detect the nervous agitation of the great internal conflict", "but in this friendly pressure raoul could detect the nervous agitation of a great internal struggle", "for in this friendly pressure raoul could detect the nervous agitation of a great internal conflict", "in this friendly pressure raoul could detect the nervous agitation of a great internal conflict"], ["6930-75918-0018", "the night was clear starlit and splendid the tempest had passed away and the sweet influences of the evening had restored life peace and security everywhere", "the night was clear starlit and splendid the tempest had passed away and the sweet influences of the evening had restored life peace and security everywhere", "the night was clear starlight and splendid the tempest had passed away and the sweet influences of the evening had restored life peace and security everywhere", "the night was clear starlet and splendid the tempest had passed away and the sweet influences of the evening had restored life peace and security everywhere", "the night was clear starlit and splendid this tempest had passed away and the sweet influences of the evening had restored life peace and security everywhere", "the night was clear starlit and splendid the tempest had passed away and the sweet influences of the evening had restored life peace and security everywhere all"], ["6930-75918-0019", "upon the large square in front of the hotel the shadows of the tents intersected by the golden moonbeams formed as it were a huge mosaic of jet and yellow flagstones", "upon the large square in front of the hotel the shadows of the tents intersected by the golden moonbeams formed as it were a huge mosaic of jet", "upon the large square in front of the hotel the shadows of the tents intersected by golden moonbeams formed as it were a huge mosaic of jet and", "upon the large square in front of the hotel the shadows of the tents intercepted by the golden moonbeams formed as it were a huge mosaic of jet and", "upon the larger square in front of the hotel the shadows of the tents intersected by the golden moonbeams formed as it were a huge mosaic of jet", "upon the large square in front of the hotel the shadows of the tents intersected by the golden moonbeams formed as it were a huge mosaic of jets"], ["6930-75918-0020", "bragelonne watched for some time the conduct of the two lovers listened to the loud and uncivil slumbers of manicamp who snored as imperiously as though he was wearing his blue and gold instead of his violet suit", "braggelonne watched for some time the conduct of the two lovers listened to the loud and uncivil slumbers of manicamp who snored as imperiously as though he was wearing his blue and gold instead of his violet suit", "bragelonne watched for some time the conduct of the two lovers listened to the loud and uncivil slumbers of manicamp who snored as imperiously as though he was wearing his blue and gold instead of his violet suit", "braggolonne watched for some time the conduct of the two lovers listened to the loud and uncivil slumbers of manicamp who snored as imperiously as though he was wearing his blue and gold instead of his violet suit", "braggelonne watched for some time the conduct of the two lovers listened to the loud and uncivil slumbers of manicheamp who snored as imperiously as though he was wearing his blue and gold instead of his violet suit", "braggelonne watched for some time the conduct of the two lovers listened to the loud and uncivil slumbers of manicamp who snored as imperiously as though he was wearing his blue and gold instead of his violet suit"], ["6930-76324-0000", "goliath makes another discovery", "goliath makes another discovery", "gytheoth makes another discovery", "gliath makes another discovery", "gelythe makes another discovery", "giath makes another discovery"], ["6930-76324-0001", "they were certainly no nearer the solution of their problem", "they were certainly no nearer the solution of their problem", "there were certainly no nearer the solution of their problem", "they were certainly no nearer the solution of the problem", "them were certainly no nearer the solution of their problem", "were certainly no nearer the solution of their problem"], ["6930-76324-0002", "the poor little things cried cynthia think of them having been turned to the wall all these years", "the poor little things cried cynthia think of them having been turned to the wall all these years", "the poor little things cried cynthia think of them having been turn to the wall all these years", "the poor little things cried cynthia think of their having been turned to the wall all these years", "the poor little ones cried cynthia think of them having been turned to the wall all these years", "the poor little things cried cynthia think of them having been turned to the wall all these years and"], ["6930-76324-0003", "now what was the sense of it two innocent babies like that", "now what is the sense of it two innocent babies like that", "now what is the sense of it two innocent babies like that and", "now what is the sense of it two innocent babies like this", "now what is the sense of it to innocent babies like that", "now what is the sense of it two innocent puppies like that"], ["6930-76324-0004", "but joyce had not been listening all at once she put down her candle on the table and faced her companion", "but joyce had not been listening all at once she put down her candle on the table and faced her companion", "but joyce had not been listening all at once she put down her candle on a table and faced her companion", "butjoyce had not been listening all at once she put down her candle on the table and faced her companion", "but joyce had not been listening all at once she put down her candle on her table and faced her companion", "but joyce had not been listening all at once she put down her candle on the table and faced her comrade"], ["6930-76324-0005", "the twin brother did something she didn't like and she turned his picture to the wall", "the twin brother did something she didn't like and she turned his picture to the wall", "the twin brother did something she didn't like as she turned his picture to the wall", "the twin brother did something she didn't like but she turned his picture to the wall", "the twin brother did something she didn't like and she turned his picture to the wall", "the twin brother did something she didn't like and she turned this picture to the wall"], ["6930-76324-0006", "hers happened to be in the same frame too but she evidently didn't care about that", "hers happened to be on the same frame too but she evidently didn't care about it", "her's happened to be on the same frame too but she evidently didn't care about it", "hers happened to be on the same frame too but she evidently didn't care about it", "hers happened to be on the same frame too but she evidently didn't care about it'", "herce happened to be on the same frame too but she evidently didn't care about it"], ["6930-76324-0007", "now what have you to say cynthia sprague", "now what have you to say cynthia sprague", "now what have you to say cynthia sprigg", "now what have you to say cynthia sprog", "now what have you to say cynthia sprigge", "now what have you to say cynthia spargo"], ["6930-76324-0008", "i thought we were stumped again when i first saw that picture but it's been of some use after all", "i thought we were stumped again when i first saw that picture but it's been of some use after all", "i thought we were stumped again when i first saw that picture but it has been of some use after all", "i thought we were stumped again when i first saw that picture but it s been of some use after all", "i thought we were stumped again when i first saw the picture but it's been of some use after all", "i thought we were stacked again when i first saw that picture but it's been of some use after all"], ["6930-76324-0009", "do you suppose the miniature was a copy of the same thing", "do you suppose the miniature was a copy of the same thing", "do you suppose that miniature was a copy of the same thing", "do you suppose the miniature was a copy of the same thing you", "do you suppose the miniature was a copy of the same thingyou", "do you suppose the miniature was a copy of the same thing and"], ["6930-76324-0010", "what in the world is that queried joyce", "what in the world is it queried joyce", "what in the world is it inquired joyce", "what in the world is it questioned joyce", "what in the world is it queried joyice", "what in the world is it cautioned joyce"], ["6930-76324-0011", "they worry me terribly and besides i'd like to see what this lovely furniture looks like without such quantities of dust all over it good scheme cyn", "may worry me terribly and besides i'd like to see what this lovely furniture looks like without such quantities of dust all over it good scheme sin", "may worry me terribly and besides i'd like to see what this lovely furniture looks like without such quantities of dust all over it good scheme sym", "may worry me terribly and besides i'd like to see what this lovely furniture looks like without such quantities of dust all over it good scheme sinne", "may weary me terribly and besides i'd like to see what this lovely furniture looks like without such quantities of dust all over it good scheme sin", "may worry me terribly and besides i'd like to see what this lovely furniture looks like without such quantities of dust all over it good scheme sinn"], ["6930-76324-0012", "we'll come in here this afternoon with old clothes on and have a regular house cleaning", "will come in here this afternoon with old clothes on and have a regular house cleaning", "will come in here this afternoon with old clothes on and have regular house cleaning", "will come in here this afternoon with old clothes on and have a reg'lar house cleaning", "will come in here this afternoon with old clothes on and have a regular house cooking", "will come in here this afternoon with old clothes on and have a regular house baking"], ["6930-76324-0013", "it can't hurt anything i'm sure for we won't disturb things at all", "it can't hurt anything i'm sure for we won't disturb things at all", "it can't hurt anything i m sure for we won't disturb things at all", "it can't hurt anything i am sure for we won't disturb things at all", "it can't hurt something i'm sure for we won't disturb things at all", "it can't hurt anything i'm sure for we won't stir things at all"], ["6930-76324-0014", "this thought however did not enter the heads of the enthusiastic pair", "this thought however did not enter the heads of the enthusiastic pair", "this thought however did not enter the heads of the enthusiastic pair and", "this thought however had not enter the heads of the enthusiastic pair", "this thought however did not enter the heads of the enthusiastic per", " this thought however did not enter the heads of the enthusiastic pair"], ["6930-76324-0015", "smuggling the house cleaning paraphernalia into the cellar window unobserved that afternoon proved no easy task for cynthia had added a whisk broom and dust pan to the outfit", "smuggling the house cleaning paraphernalia into the cellar window unobserved that afternoon proved no easy task for cynthia had added a whisk broom and dust pan to the outfit", "smugging the house cleaning paraphernalia into the cellar window unobserved that afternoon proved no easy task for cynthia had added a whisk broom and dust pan to the outfit", "smudging the house cleaning paraphernalia into the cellar window unobserved that afternoon proved no easy task for cynthia had added a whisk broom and dust pan to the outfit", "m smuggling the house cleaning paraphernalia into the cellar window unobserved that afternoon proved no easy task for cynthia had added a whisk broom and dust pan to the outfit", "smugling the house cleaning paraphernalia into the cellar window unobserved that afternoon proved no easy task for cynthia had added a whisk broom and dust pan to the outfit"], ["6930-76324-0016", "the lure proved too much for him and he came sporting after it as friskily as a young kitten much to cynthia's delight when she caught sight of him", "the lure proved too much for him and he came sporting after it as friskily as a young kitten much to cynthia's delight when she caught sight of him", "the lour proved too much for him and he came sporting after it as friskily as a young kitten much to cynthia's delight when she caught sight of him", "the luster proved too much for him and he came sporting after it as friskily as a young kitten much to cynthia's delight when she caught sight of him", "the luring proved too much for him and he came sporting after it as friskily as a young kitten much to cynthia's delight when she caught sight of him", "the lure proved too much for him and he came sporting after it as friscily as a young kitten much to cynthia's delight when she caught sight of him"], ["6930-76324-0017", "oh let him come along she urged i do love to see him about that old house", "oh let him come along she urged i do love to see him about that old house", "o let him come along she urged i do love to see him about that old house", "oh let him come along she urged i do love to see him about the old house", "oh let him come along she urged i do love to see him about that old house and", "oh let him come along she urged i do love to see him about that old house'"], ["6930-76324-0018", "he makes it sort of cozier", "he makes it sort of cosier", "he makes it sort of cozier", "he make it sort of cosier", "he makes it sort of cosiest", "e makes it sort of cosier"], ["6930-76324-0019", "now let's dust the furniture and pictures", "now let's dust the furniture and pictures", "now let s dust the furniture and pictures", "now let's dust the furniture and picturesyou'll let's dost the bookshelfainsheemsheemsheemsheetsheemsheentsheentsheentsheentsheentsheemsheentsheentsheentsheentsheemsheentsheentsheentsheemsheentsheentsheemsheentsheentsheemsheentsheentsheentsheentsheentsheentsheneverentsheapsheapsheventsheventsheventsheasheventsheasheventsheapsheventsheasheventsheapsheasheventsheashevents", "now let's dust the furniture and picturesyou'll let's dost the bookshelfainsheemsheemsheemsheetsheemsheentsheentsheentsheentsheentsheemsheentsheentsheentsheentsheemsheentsheentsheentsheemsheentsheentsheemsheentsheentsheemsheentsheentsheentsheentsheentsheentsheneverentsheapsheapsheventsheventsheventsheasheventsheasheventsheapsheventsheasheentsheapsheasheentsheventsheventshe", "now let's dust the furniture and picturesyou'll let's dost the bookshelfainsheemsheemsheemsheetsheemsheentsheentsheentsheentsheentsheemsheentsheentsheentsheentsheemsheentsheentsheentsheemsheentsheentsheemsheentsheentsheemsheentsheentsheentsheentsheentsheentsheneverentsheapsheapsheventsheventsheventsheasheventsheasheventsheapsheventsheasheventsheapsheasheventsheasheentshe"], ["6930-76324-0020", "yet little as it was it had already made a vast difference in the aspect of the room", "yet little as it was it had already made a vast difference in the aspect of the room", "yet little as it was it had already made a vast difference in the aspect of the room and", " yet little as it was it had already made a vast difference in the aspect of the room", "yet little as it was it had already made a vast difference in the outline of the room", "yet little as it was it had already made a vast difference in the aspect of the rooms"], ["6930-76324-0021", "surface dust at least had been removed and the fine old furniture gave a hint of its real elegance and polish", "surface dust at least had been removed and the fine old furniture gave a hint of its real elegance and polish", "surface dust at least had been removed and the fine old furniture gave a hint of its real elegance and polish", "material dust at least had been removed and the fine old furniture gave a hint of its real elegance and polish", "sructure dust at least had been removed and the fine old furniture gave a hint of its real elegance and polish", "service dust at least had been removed and the fine old furniture gave a hint of its real elegance and polish"], ["6930-76324-0022", "then she suddenly remarked", "then she suddenly remarked", "then' she suddenly remarked", "then she suddenly remarked i'm tommah you've gotheemed you've hemmah you've gotheemed you've gotheemed you've gotheemedly said you're tommah you've hemmah you've gothe tommah sohnah you're tommah you've gothe tommah you've gothe tommah you've hemmah tome sohnah didge to beah you'll beah she didge to shaevery he murmurah you've gothe to gethe to gethe to beke to beke to beke to beke to beke to beke to befen she didge to befen she didge to befen she didge to beke onsie sofen she didge sofen she didge sofen she", "then she suddenly remarked i'm tommah you've gotheemed you've hemmah you've gotheemed you've gotheemed you've gotheemedly said you're tommah you've hemmah you've gothe tommah sohnah you're tommah you've gothe tommah you've gothe tommah you've hemmah tome sohnah didge to beah you'll beah she didge to shaevery he murmurah you've gothe to gethe to gethe to beke to beke to beke to beke to beke to beke to befen she didge to befen she didge to befen she didge to beke onie sofen she didge sofen she didge sofen she", "then she suddenly remarked i'm tommah you've gotheemed you've hemmah you've gotheemed you've gotheemed you've gotheemedly said you're tommah you've hemmah you've gothe tommah sohnah you're tommah you've gothe tommah you've gothe tommah you've hemmah tome sohnah didge to beah you'll beah she didge to shaevery he murmurah you've gothe to gethe to gethe to beke to beke to beke to beke to beke to beke to befen she didge to befen she didge to befen she didge to beke onsie sofen she didge sofen she didge sofen she suddenly"], ["6930-76324-0023", "and my pocket money is getting low again and you haven't any left as usual", "and my pocket money is getting low again and you haven't any left as usual", "and my pocketmoney is getting low again and you haven't any left as usual", "and my pocket money is getting down again and you haven't any left as usual", "and my pocket money is getting low again and you haven't extra left as usual", "and my pocket money is getting low again and you haven't any left as usual and"], ["6930-76324-0024", "they say illumination by candle light is the prettiest in the world", "they say illumination by candlelight is the prettiest in the world", "they say illumination by candle light is the prettiest in the world", "they say illumination by candleight is the prettiest in the world", "they say illustration by candlelight is the prettiest in the world", "they say illustration by candle light is the prettiest in the world"], ["6930-76324-0025", "why it's goliath as usual they both cried peering in", "why it's goliath as usual they both cried peering in", "why it's galliath as usual they both cried peering in", "why it's guileth as usual they both cried peering in", "why it's galliaph as usual they both cried peering in", "why it's goliath as usual they both cried peering in and"], ["6930-76324-0026", "isn't he the greatest for getting into odd corners", "isn't he the greatest for getting into odd corners", "isn't he the largest for getting into odd corners", "it isn't he the greatest for getting into odd corners", "isn't he the richest for getting into odd corners", " isn't he the greatest for getting into odd corners"], ["6930-76324-0027", "forgetting all their weariness they seized their candles and scurried through the house finding an occasional paper tucked away in some odd corner", "forgetting all their weariness they seized their candles and scurried through the house finding on occasional paper tucked away in some odd corner", "forgetting all their weariness they seized their candles and skurried through the house finding on occasional paper tucked away in some odd corner", "forgetting all their weariness they seized their candles and scurried through the house finding on occasional paper tuck'd away in some odd corner", "forgetting all their weariness they seized their candles and scurried through the house finding on occasional paper tucked away in some odd corner", "forgetting all their weariness they seized their candles and scurried through the house finding on occasional paper tucked away in some odd corner a"], ["6930-76324-0028", "well i'm convinced that the boarded up house mystery happened not earlier than april sixteenth eighteen sixty one and probably not much later", "well i'm convinced that the boarded up house mystery happened not earlier than april sixteenth eighteen sixty one and probably not much later", "well i'm convinced that that boarded up house mystery happened not earlier than april sixteenth eighteen sixty one and probably not much later", "well i am convinced that the boarded up house mystery happened not earlier than april sixteenth eighteen sixty one and probably not much later", "well i am convinced that that boarded up house mystery happened not earlier than april sixteenth eighteen sixty one and probably not much later", "well i'm confident that the boarded up house mystery happened not earlier than april sixteenth eighteen sixty one and probably not much later"]]}

wandb/run-20220828_085247-2hx8pk65/files/media/table/validation.other/step_50k_50000_6fcf279cf374320c0391.table.json

@@ -0,0 +1 @@
+{"columns": ["id", "label_str", "beam_1", "beam_2", "beam_3", "beam_4", "beam_5"], "data": [["3660-172183-0000", "geraint as he had been used to do when he was at arthur's court frequented tournaments", "drenched as he had been used to do when he was at arthur's court frequented tournaments", "drain as he had been used to do when he was at arthur's court frequented tournaments", "draint as he had been used to do when he was at arthur's court frequented tournaments", "draint as he had been used to do when he was at arthur's court frequented tournaments", "drainet as he had been used to do when he was at arthur's court frequented tournaments"], ["3660-172183-0001", "before geraint the scourge of the enemy i saw steeds white with foam and after the shout of battle a fearful torrent", "before durrant the scourge of the enemy i saw steeds white with foam and after the shout of battle a fearful torrent", "before durrance the scourge of the enemy i saw steeds white with foam and after the shout of battle a fearful torrent", "before durint the scourge of the enemy i saw steeds white with foam and after the shout of battle a fearful torrent", "before durant the scourge of the enemy i saw steeds white with foam and after the shout of battle a fearful torrent", "before duraint the scourge of the enemy i saw steeds white with foam and after the shout of battle a fearful torrent"], ["3660-172183-0002", "these tidings came to erbin", "these tidings came to urban", "these tidings came to her an", "these tidings came to heron", "these tidings came to bourbon", "these tidings came to her own"], ["3660-172183-0003", "not i by my confession unto heaven said she there is nothing more hateful unto me than this", "not i by my confession unto heaven said she there is nothing more hateful unto me than this", "not i by my confession unto heaven said she there is nothing more hateful unto me then this", " not i by my confession unto heaven said she there is nothing more hateful unto me than this", "nor i by my confession unto heaven said she there is nothing more hateful unto me than this", "not by my confession unto heaven said she there is nothing more hateful unto me than this"], ["3660-172183-0004", "and the tears she shed and the words she had spoken awoke him", "and the tears she said and the words she had spoken awoke him", "and the tears she sighed and the words she had spoken awoke him", "and the tears she shed and the words she had spoken awoke him", "and the tears she said and the words she had spoken woke him", "the tears she said and the words she had spoken awoke him"], ["3660-172183-0005", "and evil betide me said he if thou returnest here until thou knowest whether i have lost my strength so completely as thou didst say", "and evil betide me said he if thou returnest here until thou knowest whether i have lost my strength so completely as thou didst say", "an evil betide me said he if thou returnest here until thou knowest whether i have lost my strength so completely as thou didst say", "and evil betide me said he if thou return'st here until thou knowest whether i have lost my strength so completely as thou didst say", "and evil betide me said he if thou returnst here until thou knowest whether i have lost my strength so completely as thou didst say", "and evil betide me said he if thou returnnest here until thou knowest whether i have lost my strength so completely as thou didst say"], ["3660-172183-0006", "then geraint went to see erbin", "then jerin went to see urban", "then jerrine went to see urban", "then jerain went to see urban", "then jarrett went to see urban", "then jeraine went to see urban"], ["3660-172183-0007", "sir said he i am going upon a quest and i am not certain when i may come back", "sir said he i am going upon a quest and i am not certain when i may come back", "sir said he i am going upon the quest and i am not certain when i may come back", "sir sighed he i am going upon a quest and i am not certain when i may come back", "sir said he i am going upon a quest and i am not certainly when i may come back", "sirs said he i am going upon a quest and i am not certain when i may come back"], ["3660-172183-0008", "take heed therefore unto thy possessions until my return", "take heed therefore into thy possessions until my return", "take heed therefore unto thy possessions until my return", "take heed therefore until thy possessions until my return", "take heed therefore into thy possessions until my return", "take heed therefore into thy possessions until my return"], ["3660-172183-0009", "but one person only will go with me", "but one person only will go with me", "but one person only will go at me", "but one person only will go away with me", "but one person only will go to me", "but one person only will go in with me"], ["3660-172183-0010", "and he desired enid to mount her horse and to ride forward and to keep a long way before him", "and he desired enid to mount her horse and to ride forward and to keep a long way before him", "and he desired enna to mount her horse and to ride forward and to keep a long way before him", "and he desired enid to mount her horse and to ride forward and keep a long way before him", "and he desired eunid to mount her horse and to ride forward and to keep a long way before him", "then he desired enid to mount her horse and to ride forward and to keep a long way before him"], ["3660-172183-0011", "and unless i speak unto thee say not thou one word either", "and unless i speak unto thee say not thou one word either", "and unless i speak unto thee say not thou one word neither", "and unless i speak unto thee pray not thou one word either", "and unless i speak unto thee say not thou one word therefore", "and unless i speak unto thee say not thou one word either to"], ["3660-172183-0012", "and though thou shouldst desire to see my defeat and my death by the hands of those men yet do i feel no dread", "and though thou shouldst desire to see my defeat in my death by the hands of those men yet do i feel no dread", "and though thou should'st desire to see my defeat in my death by the hands of those men yet do i feel no dread", "and though thou shouldest desire to see my defeat in my death by the hands of those men yet do i feel no dread", "and though thou shouldst desire to see my defeat and my death by the hands of those men yet do i feel no dread", "and though thou shouldst desire to see my defeat in my death by the hands of these men yet do i feel no dread"], ["3660-172183-0013", "and he received him and that not feebly", "and he received him and that not feebly", "and he receiv'd him and that not feebly", "and he receive'd him and that not feebly", "as he received him and that not feebly", "and he received him and that not feebly to"], ["3660-172183-0014", "and say not one word unto me unless i speak first unto thee", "and say not one word unto me unless i speak first unto thee", "and say not one word unto me unless i spoke first unto thee", "and say not one word unto me unless i speak first unto the thee", "and say not one word unto me unless i spake first unto thee", "and say not one word unto me unless i speak first unto thee to"], ["3660-172183-0015", "i will do as far as i can lord said she according to thy desire", "i will do as far as i can lord said she according to thy desire", "i will do as far as i can lord says she according to thy desire", "i will do as far as i can lord said she according to thy desires", "i will do as far as i can lord said she according to thy desir", "i will do as far as i can lord said she according to thy desire"], ["3660-172183-0016", "ah maiden said he it is vain to attempt proceeding forward", "ah maiden said he it is vain to attempt proceeding forward", "ah maiden said he it is vain to attempt proceeding forward", "ah maiden said he it is vain to attempt proceeding forward", "ay maiden said he it is vain to attempt proceeding forward", "ah maidens said he it is vain to attempt proceeding forward"], ["3660-172183-0017", "i cannot by any means refrain from sleep through weariness said he do thou therefore watch the horses and sleep not", "i cannot by any means refrain from sleep through weariness said he do thou therefore wash the horses and sleep not", "i cannot by any means refrain from sleep through weariness said he do thou therefore watch the horses and sleep not", "i can not by any means refrain from sleep through weariness said he do thou therefore wash the horses and sleep not", "i cannot by any means refrain from sleep through weariness said he do thou therefore wash thy horses and sleep not", "i cannot by any means refrain from sleep through weariness said he do thou therefore walk the horses and sleep not"], ["3660-172183-0018", "and when she saw the dawn of day appear she looked around her to see if he were waking and thereupon he woke", "and when she saw the dawn of day appear she looked around her to see if he were waking and thereupon he woke", "and when she saw the dawn of day appear she looked around her to see if he were waking and thereupon he awoke", "and when she saw the dawn of day appear she looked around her to see if he were waking and thereupon he woke", "and when she saw the dawn of day appear she looked round her to see if he were waking and thereupon he woke", "but when she saw the dawn of day appear she looked around her to see if he were waking and thereupon he woke"], ["3660-172183-0019", "and they left the wood and they came to an open country with meadows on one hand and mowers mowing the meadows", "and they left the wood and they came to an open country with meadows on one hand and moa's mowing the meadows", "and they left the wood and they came to an open country with meadows on one hand and mohas mowing the meadows", "and they left the wood and they came to an open country with meadows on one hand and moas mowing the meadows", "and they left the wood and they came to an open country with meadows on one hand and mowers mowing the meadows", "and they left the wood and they came to an open country with meadows on one hand and moays mowing the meadows"], ["3660-172183-0020", "my lord he added will it be displeasing to thee if i ask whence thou comest also", "my lord he added will it be displeasing to thee if i ask whence thou comest also", "my lord he added will it be displeasing to thee if i ask whence thou comest also", "my lord he added will it be dis displeasing to thee if i ask whence thou comest also", "my lord he added will it be displeasing to thee because i ask whence thou comest also", "my lord he added will it be displeaseing to thee if i ask whence thou comest also"], ["3660-172183-0021", "wilt thou follow my counsel said the youth and take thy meal from me", "wilt thou follow my counsel said the youth and take thy meal from me", "wilt thou following my counsel said the youth and take thy meal from me", "whilt thou follow my counsel said the youth and take thy meal from me", "wilt thou followed my counsel said the youth and take thy meal from me", "wilt thou follow my counsel said the youth and take thy meal from me to"], ["3660-172183-0022", "what sort of meal he inquired", "what sort of meal he inquired", "what sort of meal he enquired", "what sort of meal he inquired and", "what sort of meal he inquired to", "what sort of meal he enquired and"], ["3660-172183-0023", "then they washed and took their repast", "then they washed and took their repast", "then they washed and took their repasts", "then they washed and took their repaste", "they washed and took their repast", "then they washed and took the repast"], ["3660-172183-0024", "i go now lord said he to meet the knight and to conduct him to his lodging", "i go now lord said he to meet the knight and to conduct him to his lodging", "i go now lord said he to meet that knight and to conduct him to his lodging", "i go now lord said he to meet the knight and to command him to his lodging", "i go now lord said he to meet the knight and to conduct him to his lodging", "i go now lord said he to meet this knight and to conduct him to his lodging"], ["3660-172183-0025", "i will do lord said she as thou sayest", "i will do lord said she as thou sayest", "i will do lord said she as thou say'st", "i will do lord said she as thou mayest", "i will do lord said she as thou saith", "i will do lord said she as thou saist"], ["3660-172183-0026", "and after they had eaten and drank geraint went to sleep and so did enid also", "and after they had eaten and drank jeraine went to sleep and so did enid also", "and after they had eaten and drank jerrine went to sleep and so did enid also", "and after they had eaten and drank durrain went to sleep and so did enid also", "and after they had eaten and drank dorraine went to sleep and so did enid also", "and after they had eaten and drank dorrain went to sleep and so did enid also"], ["3660-6517-0000", "the dates seem unimportant but throughout the period the officers and men of the ship have been unremittingly busy", "the dates seem unimportant but throughout the period the officers and men of the ship have been unremittingly busy", "the dates seem unimportant but throughout the period the officers and men of the ship have been remittingly busy", "the details seem unimportant but throughout the period the officers and men of the ship have been unremittingly busy", "the dates seem unnecessary but throughout the period the officers and men of the ship have been unremittingly busy", "the dates seem inappropriate but throughout the period the officers and men of the ship have been unremittingly busy"], ["3660-6517-0001", "bowers attacked the ship's stores surveyed relisted and restowed them saving very much space by unstowing numerous cases and stowing the contents in the lazarette", "bowers attacked the ship's stores surveyed relisted and re stowed them saving very much space by unstowing numerous cases and stowing the contents in the lazarette", "bowers attacked the ship's stores surveyed re listed and re stowed them saving very much space by unstowing numerous cases and stowing the contents in the lazarette", "bowes attacked the ship's stores surveyed relisted and re stowed them saving very much space by unstowing numerous cases and stowing the contents in the lazarette", "bowers attacked the ship's stores surveyed re enlisted and re stowed them saving very much space by unstowing numerous cases and stowing the contents in the lazarette", "bowers attacked the ship's stores surveyed relisted and re stowed them saving very much space by unstowing numerous cases and stowing the contents in the lazarette"], ["3660-6517-0002", "without steam the leak can now be kept under with the hand pump by two daily efforts of a quarter of an hour to twenty minutes", "without steam the leak can now be kept under with the hand pump by two daily efforts of a quarter of an hour to twenty minutes", "without steam the leek can now be kept under with the hand pump by two daily efforts of a quarter of an hour to twenty minutes", "without steam the leech can now be kept under with the hand pump by two daily efforts of a quarter of an hour to twenty minutes", "without steam the leak now be kept under with the hand pump by two daily efforts of a quarter of an hour to twenty minutes", "without steam the leak has now be kept under with the hand pump by two daily efforts of a quarter of an hour to twenty minutes"], ["3660-6517-0003", "as the ship was and in her present heavily laden condition it would certainly have taken three to four hours each day", "as the ship was and in her present heavily laden condition it would certainly have taken three to four hours each day", "as the ship was and in her present heavily laden condition it would certainly have taken three to four hours each day and", "as the ship was and in her present heavily laden condition it would certainly have taken three to four hours each day they", "as the ship was and in her present heavily laden condition it would certainly have taken three to four hours each day i", "as the ship was and in her present heavily laden condition it would certainly have taken three to four hours each day that"], ["3660-6517-0004", "the large green tent was put up and proper supports made for it", "the large green tent was put up and proper supports made for it", "the large green tent was put up and proper support made for it", "the large green tent was put up and proper positions made for it", "the large green tent was put up and proper supporters made for it", "the large green tent was set up and proper supports made for it"], ["3660-6517-0005", "the engine room staff and anderson's people on the engines scientists were stowing their laboratories the cook refitting his galley and so forth not a single spot but had its band of workers", "the engine room staff and andersen's people on the engines scientists was stowing their laboratories the cookery fitting his galley and so forth not a single spot but had its band of workers", "the engine room staff and anderson's people on the engines scientists was stowing their laboratories the cookery fitting his galley and so forth not a single spot but had its band of workers", "the engine room staff and andersen's people on the engines scientists were stowing their laboratories the cookery fitting his galley and so forth not a single spot but had its band of workers", "the engine room staff and andersen's people on the engines scientists was storing their laboratories the cookery fitting his galley and so forth not a single spot but had its band of workers", "the engine room staff and anderson's people on the engines scientists were stowing their laboratories the cookery fitting his galley and so forth not a single spot but had its band of workers"], ["3660-6517-0006", "the men's space such as it is therefore extends from the fore hatch to the stem on the main deck", "the man's space such as it is therefore extends from the fore hatch to the stem on the main deck", "the men's space such as it is therefore extends from the fore hatch to the stem on the main deck", "the man space such as it is therefore extends from the fore hatch to the stem on the main deck", "the men space such as it is therefore extends from the fore hatch to the stem on the main deck", "the man s space such as it is therefore extends from the fore hatch to the stem on the main deck"], ["3660-6517-0007", "under the forecastle are stalls for fifteen ponies the maximum the space would hold the narrow irregular space in front is packed tight with fodder", "under the forecastle are stalls for fifteen ponies the maximum the space would hold the narrow irregular space in front is packed tight with fodder", "under the forecastle are stalls for fifteen ponies the maxim the space would hold the narrow irregular space in front is packed tight with fodder", "under the forecastle are stalls of fifteen ponies the maximum the space would hold the narrow irregular space in front is packed tight with fodder", "under the forecastle or stalls for fifteen ponies the maximum the space would hold the narrow irregular space in front is packed tight with fodder", "under the forecastle are stalls for fifteen ponies the maximum the space would hold the narrow irregular space in front is packed tight with foger"], ["3660-6517-0008", "immediately behind the forecastle bulkhead is the small booby hatch the only entrance to the men's mess deck in bad weather", "immediately behind the forecastle bulkhead is a small booby hatch the only entrance to the men's mess deck in bad weather", "immediately behind the forecastle bulkhead is a small booby hatch the only entrance to the mens mess deck in bad weather", "immediately behind the fore castle bulkhead is a small booby hatch the only entrance to the men's mess deck in bad weather", "immediately behind the forecastle bulk head is a small booby hatch the only entrance to the men's mess deck in bad weather", "immediately behind the forecastle bulkhead is a small booby hatch the only enter into the men's mess deck in bad weather"], ["3660-6517-0009", "abaft the fore hatch is the ice house", "abaft the fore hatch is the ice house", "abaft the fore hatch is the issehouse", "abaft the fore hatch is the isse house", "abaft the fore hatch is the ise house", "abaft the fore hatch is the eyeshouse"], ["3660-6517-0010", "we managed to get three tons of ice one hundred sixty two carcases of mutton and three carcases of beef besides some boxes of sweetbreads and kidneys into this space", "we managed to get three tons of ice one hundred sixty two caucasus of mutton and three caucasus of beef besides some boxes of sweetbreads and kidneys into this space", "we managed to get three tons of ice one hundred sixty two caucasus of mutton and three caucasuses of beef besides some boxes of sweetbreads and kidneys into this space", "we managed to get three tons of ice one hundred sixty two carcasses of mutton and three caucasus of beef besides some boxes of sweetbreads and kidneys into this space", "we managed to get three tons of ice one hundred sixty two caucasuses of mutton and three caucasus of beef besides some boxes of sweetbreads and kidneys into this space", "we managed to get three tons of ice one hundred sixty two carcasses of mutton and three carcasses of beef besides some boxes of sweetbreads and kidneys into this space"], ["3660-6517-0011", "the sacks containing this last added to the goods already mentioned make a really heavy deck cargo and one is naturally anxious concerning it but everything that can be done by lashing and securing has been done", "the sacks containing this last added to the goods already mentioned make a really heavy deck cargo and one is naturally anxious concerning it but everything that can be done by lashing and securing has been done", "", "", "", ""], ["3660-6517-0012", "forage i originally ordered thirty tons of compressed oaten hay from melbourne", "forage i originally ordered thirty tons of compressed oat and hay from melbourne", "forage i originally ordered thirty tons of compressed oats and hay from melbourne", "forage i originally ordered thirty tons of compressed oak and hay from melbourne", "fordage i originally ordered thirty tons of compressed oat and hay from melbourne", "fordage i originally ordered thirty tons of compressed oats and hay from melbourne"], ["3660-6517-0013", "the scene is wholly enchanting and such a view from some sheltered sunny corner in a garden which blazes with masses of red and golden flowers tends to feelings of inexpressible satisfaction with all things", "the scene is wholly enchanting and such a view from some sheltered sunny corner in a garden which blazes with masses of red and golden flowers tends to feelings of inexpressible satisfaction with all things", "the scene is wholly enchanting and such a view from some sheltered sunny corner in the garden which blazes with masses of red and golden flowers tends to feelings of inexpressible satisfaction with all things", "the scene is wholly enchanting and such a view from some sheltered sunny corner in a garden which blazes with masses of red and gold flowers tends to feelings of inexpressible satisfaction with all things", "that scene is wholly enchanting and such a view from some sheltered sunny corner in a garden which blazes with masses of red and golden flowers tends to feelings of inexpressible satisfaction with all things", "this scene is wholly enchanting and such a view from some sheltered sunny corner in a garden which blazes with masses of red and golden flowers tends to feelings of inexpressible satisfaction with all things"], ["3660-6517-0014", "a great mass of people assembled", "a great mass of people assembled", "a great mass of people gathered", "the great mass of people assembled", "a great mass of peoples assembled", "a great mass of people assembled and"], ["3660-6517-0015", "k and i lunched with a party in the new zealand company's ship ruapehu", "kay and i lunch with a party in the new zealand company ship rupehu", "kay and i lunch with a party in the new zealand company ship rupehoo", "kay and i lunch with a party in the new zealand company ship rupo", "kay and i lunch with a party in the new zealand company ship rupero", "kay and i lunch with a party in the nezleland company ship rupehoo"], ["3660-6517-0016", "telegram to say terra nova had arrived sunday night", "telegram to say tarrinova had arrived sunday night", "telegram to say tarrinovna had arrived sunday night", "telegram to say tarenova had arrived sunday night", "telegram to say treninova had arrived sunday night", "telegram to say tarantova had arrived sunday night"], ["3660-6517-0017", "a third sledge stands across the break of the poop in the space hitherto occupied by the after winch", "a third sledge stands across the break of the poop in the space hitherto occupied by the after winch", "a third sledge stands across the break of the poop in the space hitherto occupied by the after wench", "a third sledge stands across the break of the poop in the space hitherto occupied by the afterwench", "a third sledge stands across the break of the poop in the space hitherto occupied by the afterwinch", "a third sledge stands across the break of the poop in the space hitherto occupied by the after wrench"], ["3660-6517-0018", "the quantity is two and a half tons and the space occupied considerable", "the quantity is two and a half tons and the space occupied considerable", "the quantity is two and half tons and the space occupied considerable", "the quantity is two and a half tones and the space occupied considerable", "the quantity is two and three tons and the space occupied considerable", "the quantity is two or a half tons and the space occupied considerable"], ["3660-6517-0019", "the ship was over two feet by the stern but this will soon be remedied", "the ship was over two feet by the stern but this will soon be remedied", "the ship was over two feet by the stern' but this will soon be remedied", "the ship was over two feet by the stern this will soon be remedied", "the ship was over two feet by the stern but this will soon be remedy'd", "the ship was over two feet by the stern but this will soon be regretted"], ["3660-6517-0020", "they must perforce be chained up and they are given what shelter is afforded on deck but their position is not enviable", "they must perforce be chained up and they are given what shelter is afforded on deck but their position is not enviable", "they must perforce be chain'd up and they are given what shelter is afforded on deck but their position is not enviable", "they must perforce be chained up and they are given what shelter is afforded on deck but their position is not enviable", "they must perforce be chained up and they are given what shelter is aforeded on deck but their position is not enviable", "they must perforce be chained up and are given what shelter is afforded on deck but their position is not enviable"], ["3660-6517-0021", "it is a pathetic attitude deeply significant of cold and misery occasionally some poor beast emits a long pathetic whine", "it is a pathetic attitude deeply significant of cold and misery occasionally some poor beast emits a long pathetic whine", "it is a pathetic attitude deeply significant of cold and misery occasionally some poor beast e lets a long pathetic whine", "it is a pathetic attitude deeply significant of cold and misery occasionally some poor beast emits a long pathetic whine", "it is a pathetic attitude deeply significant of cold and misery occasionally some poor beast emitates a long pathetic whine", "it is a pathetic attitude deeply significant of cold and misery occasionally some poor beast emanates a long pathetic whine"], ["3660-6517-0022", "there are generally one or two on watch which eases matters but it is a squash", "there are generally one or two on watch which eats matters but it is a squash", "there are generally one or two on watch which exercises matters but it is a squash", "there are generally one or two on watch which easy matters but it is a squash", "there are generally one or two on watch which uses matters but it is a squash", "there are generally one or two on watch which pains matters but it is a squash"]]}

wandb/run-20220828_085247-2hx8pk65/files/output.log

@@ -54133,3 +54133,1077 @@ To disable this warning, you can either:
 huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
 To disable this warning, you can either:
 	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+Evaluating ...:   0% 0/85 [00:00<?, ?it/s]
+Step... (48325 | Loss: 0.006273908074945211, Learning Rate: 3.385859599802643e-06, Gradient Norm: 0.1460614949464798)
+Step... (48350 | Loss: 0.0028254184871912003, Learning Rate: 3.335356723255245e-06, Gradient Norm: 0.10338709503412247)
+Step... (48375 | Loss: 0.004019684158265591, Learning Rate: 3.28484770761861e-06, Gradient Norm: 0.1249128133058548)
+Step... (48400 | Loss: 0.004758585710078478, Learning Rate: 3.2343446036975365e-06, Gradient Norm: 0.15959139168262482)
+Step... (48425 | Loss: 0.0057290843687951565, Learning Rate: 3.1838417271501385e-06, Gradient Norm: 0.3134813904762268)
+Step... (48450 | Loss: 0.0017834462923929095, Learning Rate: 3.1333327115135035e-06, Gradient Norm: 0.07752764225006104)
+Step... (48475 | Loss: 0.00752327311784029, Learning Rate: 3.08282960759243e-06, Gradient Norm: 0.1572938710451126)
+Step... (48500 | Loss: 0.0028460498433560133, Learning Rate: 3.032326731045032e-06, Gradient Norm: 0.14785446226596832)
+Step... (48525 | Loss: 0.003165456233546138, Learning Rate: 2.981817715408397e-06, Gradient Norm: 0.14088474214076996)
+Step... (48550 | Loss: 0.003088166005909443, Learning Rate: 2.9313146114873234e-06, Gradient Norm: 0.14618875086307526)
+Step... (48575 | Loss: 0.005377086345106363, Learning Rate: 2.8808055958506884e-06, Gradient Norm: 0.1480293571949005)
+Step... (48600 | Loss: 0.008808658458292484, Learning Rate: 2.8303027193032904e-06, Gradient Norm: 0.29225432872772217)
+Step... (48625 | Loss: 0.005420982837677002, Learning Rate: 2.779799615382217e-06, Gradient Norm: 0.12026731669902802)
+Step... (48650 | Loss: 0.0027397857047617435, Learning Rate: 2.729290599745582e-06, Gradient Norm: 0.15806540846824646)
+Step... (48675 | Loss: 0.00710515258833766, Learning Rate: 2.678787723198184e-06, Gradient Norm: 0.22162267565727234)
+Step... (48700 | Loss: 0.005460535641759634, Learning Rate: 2.6282846192771103e-06, Gradient Norm: 0.15932734310626984)
+Step... (48725 | Loss: 0.0032200149726122618, Learning Rate: 2.5777756036404753e-06, Gradient Norm: 0.12232287973165512)
+Step... (48750 | Loss: 0.003293083980679512, Learning Rate: 2.5272727270930773e-06, Gradient Norm: 0.1615389883518219)
+Step... (48775 | Loss: 0.006437454838305712, Learning Rate: 2.4767696231720038e-06, Gradient Norm: 0.17736835777759552)
+Step... (48800 | Loss: 0.003951036371290684, Learning Rate: 2.4262606075353688e-06, Gradient Norm: 0.14531250298023224)
+Step... (48825 | Loss: 0.005099722649902105, Learning Rate: 2.3757577309879707e-06, Gradient Norm: 0.160662442445755)
+Step... (48850 | Loss: 0.0032283207401633263, Learning Rate: 2.3252546270668972e-06, Gradient Norm: 0.13414400815963745)
+Step... (48875 | Loss: 0.0015734140761196613, Learning Rate: 2.2747456114302622e-06, Gradient Norm: 0.07306690514087677)
+Step... (48900 | Loss: 0.004713626578450203, Learning Rate: 2.224242734882864e-06, Gradient Norm: 0.37370821833610535)
+Step... (48925 | Loss: 0.00445198779925704, Learning Rate: 2.1737396309617907e-06, Gradient Norm: 0.11672279238700867)
+Step... (48950 | Loss: 0.005622401367872953, Learning Rate: 2.1232306153251557e-06, Gradient Norm: 0.36664897203445435)
+Step... (48975 | Loss: 0.004830599296838045, Learning Rate: 2.0727277387777576e-06, Gradient Norm: 0.1332392543554306)
+Step... (49000 | Loss: 0.001942885690368712, Learning Rate: 2.022224634856684e-06, Gradient Norm: 0.08187990635633469)
+Step... (49025 | Loss: 0.002983431564643979, Learning Rate: 1.971715619220049e-06, Gradient Norm: 0.12874305248260498)
+Step... (49050 | Loss: 0.003948990721255541, Learning Rate: 1.9212125152989756e-06, Gradient Norm: 0.1727469116449356)
+Step... (49075 | Loss: 0.0030416282825171947, Learning Rate: 1.8707096387515776e-06, Gradient Norm: 0.11190405488014221)
+Step... (49100 | Loss: 0.002342380816116929, Learning Rate: 1.8202006231149426e-06, Gradient Norm: 0.186001718044281)
+Step... (49125 | Loss: 0.005597165320068598, Learning Rate: 1.7696976328807068e-06, Gradient Norm: 0.1563747525215149)
+Step... (49150 | Loss: 0.006304830778390169, Learning Rate: 1.719194642646471e-06, Gradient Norm: 0.3608132302761078)
+Step... (49175 | Loss: 0.005585476290434599, Learning Rate: 1.668685627009836e-06, Gradient Norm: 0.1635635942220688)
+Step... (49200 | Loss: 0.0022299003321677446, Learning Rate: 1.6181826367756003e-06, Gradient Norm: 0.09342005848884583)
+Step... (49225 | Loss: 0.003186724614351988, Learning Rate: 1.5676796465413645e-06, Gradient Norm: 0.11787708848714828)
+Step... (49250 | Loss: 0.0044976030476391315, Learning Rate: 1.5171706309047295e-06, Gradient Norm: 0.15412402153015137)
+Step... (49275 | Loss: 0.002793824765831232, Learning Rate: 1.4666676406704937e-06, Gradient Norm: 0.12002275139093399)
+Step... (49300 | Loss: 0.005244765896350145, Learning Rate: 1.416164650436258e-06, Gradient Norm: 0.20691828429698944)
+Step... (49325 | Loss: 0.005228319205343723, Learning Rate: 1.365655634799623e-06, Gradient Norm: 0.11888090521097183)
+Step... (49350 | Loss: 0.0021032176446169615, Learning Rate: 1.3151526445653872e-06, Gradient Norm: 0.11082443594932556)
+Step... (49375 | Loss: 0.002918470650911331, Learning Rate: 1.2646496543311514e-06, Gradient Norm: 0.10087604075670242)
+Step... (49400 | Loss: 0.00608043372631073, Learning Rate: 1.2141406386945164e-06, Gradient Norm: 0.24040699005126953)
+Step... (49425 | Loss: 0.0024373417254537344, Learning Rate: 1.1636376484602806e-06, Gradient Norm: 0.11463785171508789)
+Step... (49450 | Loss: 0.002385038649663329, Learning Rate: 1.1131345445392071e-06, Gradient Norm: 0.21716482937335968)
+Step... (49475 | Loss: 0.005627614911645651, Learning Rate: 1.0626256425894098e-06, Gradient Norm: 0.23284529149532318)
+Step... (49500 | Loss: 0.0034920424222946167, Learning Rate: 1.012122652355174e-06, Gradient Norm: 0.329440176486969)
+Step... (49525 | Loss: 0.005277593154460192, Learning Rate: 9.616195484341006e-07, Gradient Norm: 0.1645783931016922)
+Step... (49550 | Loss: 0.0022860753815621138, Learning Rate: 9.111105896408844e-07, Gradient Norm: 0.08527761697769165)
+Step... (49575 | Loss: 0.00586397061124444, Learning Rate: 8.606075994066487e-07, Gradient Norm: 0.16009190678596497)
+Step... (49600 | Loss: 0.003235064446926117, Learning Rate: 8.100986406134325e-07, Gradient Norm: 0.10364442318677902)
+Step... (49625 | Loss: 0.0035986381117254496, Learning Rate: 7.595955935357779e-07, Gradient Norm: 0.11373201012611389)
+Step... (49650 | Loss: 0.001558838877826929, Learning Rate: 7.090926033015421e-07, Gradient Norm: 0.07926014810800552)
+Step... (49675 | Loss: 0.0028727748431265354, Learning Rate: 6.58583644508326e-07, Gradient Norm: 0.1340569704771042)
+Step... (49700 | Loss: 0.003118803957477212, Learning Rate: 6.080805974306713e-07, Gradient Norm: 0.12160930037498474)
+Step... (49725 | Loss: 0.003669364843517542, Learning Rate: 5.575776071964356e-07, Gradient Norm: 0.1003832146525383)
+Step... (49750 | Loss: 0.002524098614230752, Learning Rate: 5.070686484032194e-07, Gradient Norm: 0.11493940651416779)
+Step... (49775 | Loss: 0.010293897241353989, Learning Rate: 4.565656013255648e-07, Gradient Norm: 0.27238357067108154)
+Step... (49800 | Loss: 0.0035836833994835615, Learning Rate: 4.060625826696196e-07, Gradient Norm: 0.09983225166797638)
+Step... (49825 | Loss: 0.005596230737864971, Learning Rate: 3.5555362387640344e-07, Gradient Norm: 0.20980145037174225)
+Step... (49850 | Loss: 0.004051040858030319, Learning Rate: 3.0505060522045824e-07, Gradient Norm: 0.23624876141548157)
+Step... (49875 | Loss: 0.0029332884587347507, Learning Rate: 2.5454758656451304e-07, Gradient Norm: 0.12203349173069)
+Step... (49900 | Loss: 0.003682792419567704, Learning Rate: 2.0403861356044217e-07, Gradient Norm: 0.15977534651756287)
+Step... (49925 | Loss: 0.005816394928842783, Learning Rate: 1.5353559490449697e-07, Gradient Norm: 0.18484382331371307)
+Step... (49950 | Loss: 0.005385520868003368, Learning Rate: 1.0303258335397913e-07, Gradient Norm: 0.30565232038497925)
+Step... (49975 | Loss: 0.0029563589487224817, Learning Rate: 5.252361034990827e-08, Gradient Norm: 0.1044062077999115)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+                                                  /home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:291: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  batch_sizes |= {t.shape[0] for t in jax.tree_leaves(a)}
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+
+
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+
+
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+Evaluating ...: 100% 85/85 [12:23<00:00,  8.75s/it]
+  device_metrics = jax.tree_map(lambda x: x[0], device_metrics)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/training/common_utils.py:45: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(stack_args, *forest)
+run_flax_speech_recognition_seq2seq.py:1392: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  eval_metrics = jax.tree_map(jnp.mean, eval_metrics)
+run_flax_speech_recognition_seq2seq.py:336: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(lambda x: x.astype(jnp.float32) if x.dtype == jnp.bfloat16 else x, t)
+Predicting validation.other...:   0% 0/90 [00:00<?, ?it/s]
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+run_flax_speech_recognition_seq2seq.py:1308: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  loss = jax.tree_map(lambda l: l / total_samples, loss)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+run_flax_speech_recognition_seq2seq.py:336: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(lambda x: x.astype(jnp.float32) if x.dtype == jnp.bfloat16 else x, t)
+run_flax_speech_recognition_seq2seq.py:1308: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  loss = jax.tree_map(lambda l: l / total_samples, loss)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+  device_metrics = jax.tree_map(lambda x: x[0], device_metrics)/it]
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/training/common_utils.py:45: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(stack_args, *forest)
+run_flax_speech_recognition_seq2seq.py:1541: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  pred_metrics = jax.tree_map(jnp.mean, pred_metrics)
+run_flax_speech_recognition_seq2seq.py:336: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(lambda x: x.astype(jnp.float32) if x.dtype == jnp.bfloat16 else x, t)
+Predicting test.clean...:   0% 0/82 [00:00<?, ?it/s]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+run_flax_speech_recognition_seq2seq.py:1308: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  loss = jax.tree_map(lambda l: l / total_samples, loss)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+run_flax_speech_recognition_seq2seq.py:336: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(lambda x: x.astype(jnp.float32) if x.dtype == jnp.bfloat16 else x, t)
+run_flax_speech_recognition_seq2seq.py:1308: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  loss = jax.tree_map(lambda l: l / total_samples, loss)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+run_flax_speech_recognition_seq2seq.py:336: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(lambda x: x.astype(jnp.float32) if x.dtype == jnp.bfloat16 else x, t)
+run_flax_speech_recognition_seq2seq.py:1308: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  loss = jax.tree_map(lambda l: l / total_samples, loss)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+Predicting test.clean...: 100% 82/82 [11:23<00:00,  8.34s/it]
+Predicting test.clean...: 100% 82/82 [11:23<00:00, 27.78s/it]
+  device_metrics = jax.tree_map(lambda x: x[0], device_metrics)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/training/common_utils.py:45: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(stack_args, *forest)
+run_flax_speech_recognition_seq2seq.py:1541: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  pred_metrics = jax.tree_map(jnp.mean, pred_metrics)
+run_flax_speech_recognition_seq2seq.py:336: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(lambda x: x.astype(jnp.float32) if x.dtype == jnp.bfloat16 else x, t)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+run_flax_speech_recognition_seq2seq.py:1308: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  loss = jax.tree_map(lambda l: l / total_samples, loss)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:112: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  scopes, treedef = jax.tree_flatten(scope_tree)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/lift.py:729: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  lengths = set(jax.tree_leaves(lengths))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:134: FutureWarning: jax.tree_flatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_flatten instead.
+  in_avals, in_tree = jax.tree_flatten(input_avals)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/linen/transforms.py:249: FutureWarning: jax.tree_leaves is deprecated, and will be removed in a future release. Use jax.tree_util.tree_leaves instead.
+  jax.tree_leaves(tree)))
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/core/axes_scan.py:146: FutureWarning: jax.tree_unflatten is deprecated, and will be removed in a future release. Use jax.tree_util.tree_unflatten instead.
+  broadcast_in, constants_out = jax.tree_unflatten(out_tree(), out_flat)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1127: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  cache = jax.tree_map(
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1038: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(gather_fn, nested)
+/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-black-box/models/modeling_flax_speech_encoder_decoder.py:1213: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  model_outputs["past_key_values"] = jax.tree_map(lambda x: flatten_beam_dim(x), next_cache)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:321: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return out if static_return else jax.tree_map(unpad, out)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/jax_utils.py:312: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(pad, tree)
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+  device_metrics = jax.tree_map(lambda x: x[0], device_metrics)
+/home/sanchitgandhi/hf/lib/python3.8/site-packages/flax/training/common_utils.py:45: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(stack_args, *forest)
+run_flax_speech_recognition_seq2seq.py:1541: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  pred_metrics = jax.tree_map(jnp.mean, pred_metrics)
+run_flax_speech_recognition_seq2seq.py:336: FutureWarning: jax.tree_map is deprecated, and will be removed in a future release. Use jax.tree_util.tree_map instead.
+  return jax.tree_map(lambda x: x.astype(jnp.float32) if x.dtype == jnp.bfloat16 else x, t)
+run_flax_speech_recognition_seq2seq.py:1062: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray.
+  padded_ids = np.where(np.asarray(label_ids) == -100, tokenizer.pad_token_id, np.asarray(label_ids))
+run_flax_speech_recognition_seq2seq.py:1062: DeprecationWarning: elementwise comparison failed; this will raise an error in the future.
+  padded_ids = np.where(np.asarray(label_ids) == -100, tokenizer.pad_token_id, np.asarray(label_ids))

wandb/run-20220828_085247-2hx8pk65/files/wandb-summary.json

@@ -1 +1 @@
-{"train/decoder_grad_norm": 0.07715553045272827, "train/decoder_param_norm": 1063.1578369140625, "train/encoder_grad_norm": 0.07033974677324295, "train/encoder_param_norm": 2323.486572265625, "train/grad_norm": 0.1044062077999115, "layer_grad_norm/": {"decoder": {"model": {"decoder": {"embed_positions": {"embedding": 0.005401859525591135}, "embed_tokens": {"embedding": 0.03052273392677307}, "layernorm_embedding": {"bias": 0.0020871469751000404, "scale": 0.0012841655407100916}, "layers": {"FlaxBartDecoderLayers": {"encoder_attn": {"k_proj": {"bias": 1.8833308104149182e-06, "kernel": 0.004420427139848471}, "out_proj": {"bias": 0.00347402086481452, "kernel": 0.015828590840101242}, "q_proj": {"bias": 0.00020214646065142006, "kernel": 0.004523565527051687}, "v_proj": {"bias": 0.006682044826447964, "kernel": 0.012984688393771648}}, "encoder_attn_layer_norm": {"bias": 0.004988634027540684, "scale": 0.005556626245379448}, "fc1": {"bias": 0.0017050342867150903, "kernel": 0.04050837457180023}, "fc2": {"bias": 0.005049724597483873, "kernel": 0.03927548602223396}, "final_layer_norm": {"bias": 0.013566207140684128, "scale": 0.008338828571140766}, "self_attn": {"k_proj": {"bias": 5.705806529476831e-07, "kernel": 0.003607015358284116}, "out_proj": {"bias": 0.008329739794135094, "kernel": 0.015504402108490467}, "q_proj": {"bias": 0.0002979960117954761, "kernel": 0.003639827948063612}, "v_proj": {"bias": 0.00870799645781517, "kernel": 0.022596830502152443}}, "self_attn_layer_norm": {"bias": 0.003212399547919631, "scale": 0.00401513883844018}}}}}}, "encoder": {"adapter": {"layers": {"0": {"conv": {"bias": 0.009786142967641354, "kernel": 0.02071578986942768}}, "1": {"conv": {"bias": 0.007721441797912121, "kernel": 0.01437926385551691}}, "2": {"conv": {"bias": 0.009065583348274231, "kernel": 0.021983565762639046}}}}, "encoder": {"layer_norm": {"bias": 0.03353462368249893, "scale": 0.01526513509452343}, "layers": {"FlaxWav2Vec2EncoderLayers": {"attention": {"k_proj": {"bias": 1.1060902807003004e-06, "kernel": 0.00823200587183237}, "out_proj": {"bias": 0.0008450962486676872, "kernel": 0.01538914442062378}, "q_proj": {"bias": 0.0011472117621451616, "kernel": 0.008041738532483578}, "v_proj": {"bias": 0.0036684211809188128, "kernel": 0.014704424887895584}}, "feed_forward": {"intermediate_dense": {"bias": 0.002029425697401166, "kernel": 0.019275842234492302}, "output_dense": {"bias": 0.0007828964735381305, "kernel": 0.01704106293618679}}, "final_layer_norm": {"bias": 0.010386798530817032, "scale": 0.011868822388350964}, "layer_norm": {"bias": 0.01724540814757347, "scale": 0.015423807315528393}}}, "pos_conv_embed": {"conv": {"bias": 0.0002918594400398433, "weight_g": 0.0027034797240048647, "weight_v": 0.005031736101955175}}}, "feature_extractor": {"conv_layers": {"0": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "1": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "2": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "3": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "4": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "5": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "6": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}}}, "feature_projection": {"layer_norm": {"bias": 0.0014273464912548661, "scale": 0.001675860257819295}, "projection": {"bias": 0.0004162571858614683, "kernel": 0.01199527457356453}}, "masked_spec_embed": 0.0}}, "layer_param_norm/": {"decoder": {"model": {"decoder": {"embed_positions": {"embedding": 58.65697479248047}, "embed_tokens": {"embedding": 628.4302978515625}, "layernorm_embedding": {"bias": 2.422621965408325, "scale": 13.860967636108398}, "layers": {"FlaxBartDecoderLayers": {"encoder_attn": {"k_proj": {"bias": 47.94939041137695, "kernel": 331.5506591796875}, "out_proj": {"bias": 6.131547927856445, "kernel": 227.9162139892578}, "q_proj": {"bias": 20.88374137878418, "kernel": 338.4700622558594}, "v_proj": {"bias": 3.56612491607666, "kernel": 232.11032104492188}}, "encoder_attn_layer_norm": {"bias": 11.035151481628418, "scale": 57.715087890625}, "fc1": {"bias": 26.05365562438965, "kernel": 346.8977355957031}, "fc2": {"bias": 7.839730739593506, "kernel": 249.0161590576172}, "final_layer_norm": {"bias": 3.914802074432373, "scale": 63.62209701538086}, "self_attn": {"k_proj": {"bias": 59.55521011352539, "kernel": 280.0371398925781}, "out_proj": {"bias": 3.7659459114074707, "kernel": 132.872802734375}, "q_proj": {"bias": 32.20103073120117, "kernel": 283.1228942871094}, "v_proj": {"bias": 2.560319423675537, "kernel": 141.23605346679688}}, "self_attn_layer_norm": {"bias": 8.895964622497559, "scale": 84.7233657836914}}}}}}, "encoder": {"adapter": {"layers": {"0": {"conv": {"bias": 1.2016971111297607, "kernel": 62.545352935791016}}, "1": {"conv": {"bias": 1.3880459070205688, "kernel": 60.6671257019043}}, "2": {"conv": {"bias": 1.5934075117111206, "kernel": 60.4710807800293}}}}, "encoder": {"layer_norm": {"bias": 0.2923099100589752, "scale": 4.224204063415527}, "layers": {"FlaxWav2Vec2EncoderLayers": {"attention": {"k_proj": {"bias": 19.386531829833984, "kernel": 553.5894165039062}, "out_proj": {"bias": 16.841169357299805, "kernel": 705.33203125}, "q_proj": {"bias": 40.93061828613281, "kernel": 546.1094970703125}, "v_proj": {"bias": 15.554323196411133, "kernel": 696.839111328125}}, "feed_forward": {"intermediate_dense": {"bias": 24.43609619140625, "kernel": 1377.650146484375}, "output_dense": {"bias": 20.79059600830078, "kernel": 1304.09033203125}}, "final_layer_norm": {"bias": 32.522762298583984, "scale": 142.02593994140625}, "layer_norm": {"bias": 7.270603656768799, "scale": 45.793148040771484}}}, "pos_conv_embed": {"conv": {"bias": 15.207948684692383, "weight_g": 21.04806900024414, "weight_v": 214.14303588867188}}}, "feature_extractor": {"conv_layers": {"0": {"conv": {"bias": 0.5982058644294739, "kernel": 8.08896541595459}, "layer_norm": {"bias": 10.069783210754395, "scale": 10.451257705688477}}, "1": {"conv": {"bias": 4.74075174331665, "kernel": 90.8435287475586}, "layer_norm": {"bias": 6.922820091247559, "scale": 19.5467586517334}}, "2": {"conv": {"bias": 6.7732415199279785, "kernel": 146.13897705078125}, "layer_norm": {"bias": 9.044225692749023, "scale": 19.424888610839844}}, "3": {"conv": {"bias": 5.224758148193359, "kernel": 159.10508728027344}, "layer_norm": {"bias": 8.319666862487793, "scale": 17.64743423461914}}, "4": {"conv": {"bias": 4.434978008270264, "kernel": 157.35813903808594}, "layer_norm": {"bias": 9.193974494934082, "scale": 15.562357902526855}}, "5": {"conv": {"bias": 5.297643661499023, "kernel": 131.1835174560547}, "layer_norm": {"bias": 10.735219955444336, "scale": 13.812533378601074}}, "6": {"conv": {"bias": 5.615579128265381, "kernel": 136.41822814941406}, "layer_norm": {"bias": 12.515308380126953, "scale": 11.152680397033691}}}}, "feature_projection": {"layer_norm": {"bias": 9.220093727111816, "scale": 27.58247947692871}, "projection": {"bias": 4.322972774505615, "kernel": 88.09733581542969}}, "masked_spec_embed": 26.247730255126953}}, "train/learning_rate": 5.252361034990827e-08, "train/loss": 0.0029563589487224817, "train/param_norm": 2555.17041015625, "_timestamp": 1661920077, "_runtime": 243310, "_step": 49975, "eval/loss": 0.9527401328086853, "eval/wer": 0.04187346053453917, "eval/cer": 0.02872188479352137, "eval/step_10k": {"_type": "table-file", "sha256": "8b44e8a00a036a18ffdf81b4d076c8bf849ea6649001c69e94fa439b14f110ee", "size": 26434, "artifact_path": "wandb-client-artifact://18m0dj4hts3yiat04x5pvmncavkjapd5wb8bznb37vw8c0lqna3m2yjd1wtdrfstuoo7ejt2sphvjo0zuw1e5ne5d3qbkd7c1fylclfggig6us5tsmsj2uum5pchx48n:latest/eval/step_10k.table.json", "_latest_artifact_path": "wandb-client-artifact://18m0dj4hts3yiat04x5pvmncavkjapd5wb8bznb37vw8c0lqna3m2yjd1wtdrfstuoo7ejt2sphvjo0zuw1e5ne5d3qbkd7c1fylclfggig6us5tsmsj2uum5pchx48n:latest/eval/step_10k.table.json", "path": "media/table/eval/step_10k_10000_8b44e8a00a036a18ffdf.table.json", "ncols": 7, "nrows": 50}, "eval/step_20k": {"_type": "table-file", "sha256": "a0a50c5d8793ca99e4646f70c3624f8742c5285825bc1c59ab4083ac4de9d6e3", "size": 26657, "artifact_path": "wandb-client-artifact://13ri9hnxp93kf7dsdol2hs1j0v7bpkwwvujpi27awdck0fjm6vfog0dun9k9toif5xrt3cijlotddakikiw0bnbo3go679b4d2spq9c0w865vq0k9auiszkkbvev62fc:latest/eval/step_20k.table.json", "_latest_artifact_path": "wandb-client-artifact://13ri9hnxp93kf7dsdol2hs1j0v7bpkwwvujpi27awdck0fjm6vfog0dun9k9toif5xrt3cijlotddakikiw0bnbo3go679b4d2spq9c0w865vq0k9auiszkkbvev62fc:latest/eval/step_20k.table.json", "path": "media/table/eval/step_20k_20000_a0a50c5d8793ca99e464.table.json", "ncols": 7, "nrows": 50}, "eval/step_30k": {"_type": "table-file", "sha256": "509ad8614e16ae2800f100e82fd40356d3559e0425cf50e8e19c3155dc6c604e", "size": 26610, "artifact_path": "wandb-client-artifact://1v7mr89p2ldfoyyvrj6x6g0s8qpvgnioclm4puk5i0wphipeujkyna0xf7y63nt4a5qivkdzytt4lzhwuraoe53a5683ln1yzntyw9kh7vhcxz7oci70rpw62o1tz6ho:latest/eval/step_30k.table.json", "_latest_artifact_path": "wandb-client-artifact://1v7mr89p2ldfoyyvrj6x6g0s8qpvgnioclm4puk5i0wphipeujkyna0xf7y63nt4a5qivkdzytt4lzhwuraoe53a5683ln1yzntyw9kh7vhcxz7oci70rpw62o1tz6ho:latest/eval/step_30k.table.json", "path": "media/table/eval/step_30k_30000_509ad8614e16ae2800f1.table.json", "ncols": 7, "nrows": 50}, "eval/step_40k": {"_type": "table-file", "sha256": "1c187b6d789cca3b4ec0da0aa76f40085364204904c4e4e7f9a7ae021659a9ab", "size": 26557, "artifact_path": "wandb-client-artifact://tbhmdixx2c1ta253dre6w8pjaxb8fbzac6u2cugh4vsvvgiykum9l788fn7omfbr8f3ir5gq1fo2cb7bwlha8musehb13eb9eb7hppcmvnyc3gg5i8eprg7w7z0jqrgu:latest/eval/step_40k.table.json", "_latest_artifact_path": "wandb-client-artifact://tbhmdixx2c1ta253dre6w8pjaxb8fbzac6u2cugh4vsvvgiykum9l788fn7omfbr8f3ir5gq1fo2cb7bwlha8musehb13eb9eb7hppcmvnyc3gg5i8eprg7w7z0jqrgu:latest/eval/step_40k.table.json", "path": "media/table/eval/step_40k_40000_1c187b6d789cca3b4ec0.table.json", "ncols": 7, "nrows": 50}}
+{"train/decoder_grad_norm": 0.13863559067249298, "train/decoder_param_norm": 1063.157958984375, "train/encoder_grad_norm": 0.12767568230628967, "train/encoder_param_norm": 2323.486572265625, "train/grad_norm": 0.18846991658210754, "layer_grad_norm/": {"decoder": {"model": {"decoder": {"embed_positions": {"embedding": 0.00458504119887948}, "embed_tokens": {"embedding": 0.04171811044216156}, "layernorm_embedding": {"bias": 0.0017893731128424406, "scale": 0.0013935249298810959}, "layers": {"FlaxBartDecoderLayers": {"encoder_attn": {"k_proj": {"bias": 3.855697286780924e-06, "kernel": 0.0076254853047430515}, "out_proj": {"bias": 0.005279311910271645, "kernel": 0.024275174364447594}, "q_proj": {"bias": 0.00043104763608425856, "kernel": 0.00900623295456171}, "v_proj": {"bias": 0.010559052228927612, "kernel": 0.02036716602742672}}, "encoder_attn_layer_norm": {"bias": 0.0075690955854952335, "scale": 0.007609376218169928}, "fc1": {"bias": 0.00296043255366385, "kernel": 0.07841099798679352}, "fc2": {"bias": 0.007353292312473059, "kernel": 0.06499774008989334}, "final_layer_norm": {"bias": 0.03219310939311981, "scale": 0.02759859897196293}, "self_attn": {"k_proj": {"bias": 1.4209628034222987e-06, "kernel": 0.0067481594160199165}, "out_proj": {"bias": 0.019993344321846962, "kernel": 0.027441998943686485}, "q_proj": {"bias": 0.00045939383562654257, "kernel": 0.005984445568174124}, "v_proj": {"bias": 0.02075435407459736, "kernel": 0.045821528881788254}}, "self_attn_layer_norm": {"bias": 0.004965916741639376, "scale": 0.005645396187901497}}}}}}, "encoder": {"adapter": {"layers": {"0": {"conv": {"bias": 0.020777273923158646, "kernel": 0.03428618609905243}}, "1": {"conv": {"bias": 0.015944577753543854, "kernel": 0.02349558286368847}}, "2": {"conv": {"bias": 0.01633843593299389, "kernel": 0.03470488637685776}}}}, "encoder": {"layer_norm": {"bias": 0.07426025718450546, "scale": 0.030289432033896446}, "layers": {"FlaxWav2Vec2EncoderLayers": {"attention": {"k_proj": {"bias": 1.5539228570560226e-06, "kernel": 0.012733910232782364}, "out_proj": {"bias": 0.0015504145994782448, "kernel": 0.025560908019542694}, "q_proj": {"bias": 0.0018366728909313679, "kernel": 0.012664508074522018}, "v_proj": {"bias": 0.006929673720151186, "kernel": 0.024374961853027344}}, "feed_forward": {"intermediate_dense": {"bias": 0.0030178381130099297, "kernel": 0.03204876556992531}, "output_dense": {"bias": 0.0014813182642683387, "kernel": 0.028658747673034668}}, "final_layer_norm": {"bias": 0.01533432025462389, "scale": 0.016603633761405945}, "layer_norm": {"bias": 0.03334679454565048, "scale": 0.024004308506846428}}}, "pos_conv_embed": {"conv": {"bias": 0.0003798876132350415, "weight_g": 0.002687062369659543, "weight_v": 0.006322952453047037}}}, "feature_extractor": {"conv_layers": {"0": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "1": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "2": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "3": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "4": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "5": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "6": {"conv": {"bias": 0.0, "kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}}}, "feature_projection": {"layer_norm": {"bias": 0.0018814384238794446, "scale": 0.0023763789795339108}, "projection": {"bias": 0.0005655022105202079, "kernel": 0.015642477199435234}}, "masked_spec_embed": 0.0}}, "layer_param_norm/": {"decoder": {"model": {"decoder": {"embed_positions": {"embedding": 58.6569709777832}, "embed_tokens": {"embedding": 628.4302978515625}, "layernorm_embedding": {"bias": 2.422621965408325, "scale": 13.860967636108398}, "layers": {"FlaxBartDecoderLayers": {"encoder_attn": {"k_proj": {"bias": 47.94939041137695, "kernel": 331.5506591796875}, "out_proj": {"bias": 6.1315484046936035, "kernel": 227.9162139892578}, "q_proj": {"bias": 20.883743286132812, "kernel": 338.4700622558594}, "v_proj": {"bias": 3.56612491607666, "kernel": 232.11032104492188}}, "encoder_attn_layer_norm": {"bias": 11.03515338897705, "scale": 57.715087890625}, "fc1": {"bias": 26.05365562438965, "kernel": 346.8977355957031}, "fc2": {"bias": 7.839732646942139, "kernel": 249.01614379882812}, "final_layer_norm": {"bias": 3.914801597595215, "scale": 63.62208938598633}, "self_attn": {"k_proj": {"bias": 59.55521011352539, "kernel": 280.0371398925781}, "out_proj": {"bias": 3.7659456729888916, "kernel": 132.872802734375}, "q_proj": {"bias": 32.20103454589844, "kernel": 283.1228942871094}, "v_proj": {"bias": 2.5603203773498535, "kernel": 141.23605346679688}}, "self_attn_layer_norm": {"bias": 8.895964622497559, "scale": 84.72337341308594}}}}}}, "encoder": {"adapter": {"layers": {"0": {"conv": {"bias": 1.2016971111297607, "kernel": 62.54536056518555}}, "1": {"conv": {"bias": 1.3880457878112793, "kernel": 60.667118072509766}}, "2": {"conv": {"bias": 1.5934076309204102, "kernel": 60.47107696533203}}}}, "encoder": {"layer_norm": {"bias": 0.2923099100589752, "scale": 4.2242045402526855}, "layers": {"FlaxWav2Vec2EncoderLayers": {"attention": {"k_proj": {"bias": 19.386531829833984, "kernel": 553.5894165039062}, "out_proj": {"bias": 16.841169357299805, "kernel": 705.33203125}, "q_proj": {"bias": 40.93061828613281, "kernel": 546.1094970703125}, "v_proj": {"bias": 15.55432415008545, "kernel": 696.8391723632812}}, "feed_forward": {"intermediate_dense": {"bias": 24.43609619140625, "kernel": 1377.6502685546875}, "output_dense": {"bias": 20.79059600830078, "kernel": 1304.09033203125}}, "final_layer_norm": {"bias": 32.52276611328125, "scale": 142.02593994140625}, "layer_norm": {"bias": 7.270603179931641, "scale": 45.793148040771484}}}, "pos_conv_embed": {"conv": {"bias": 15.207948684692383, "weight_g": 21.04806900024414, "weight_v": 214.1430206298828}}}, "feature_extractor": {"conv_layers": {"0": {"conv": {"bias": 0.5982058644294739, "kernel": 8.08896541595459}, "layer_norm": {"bias": 10.069783210754395, "scale": 10.451257705688477}}, "1": {"conv": {"bias": 4.74075174331665, "kernel": 90.8435287475586}, "layer_norm": {"bias": 6.922820091247559, "scale": 19.5467586517334}}, "2": {"conv": {"bias": 6.7732415199279785, "kernel": 146.13897705078125}, "layer_norm": {"bias": 9.044225692749023, "scale": 19.424888610839844}}, "3": {"conv": {"bias": 5.224758148193359, "kernel": 159.10508728027344}, "layer_norm": {"bias": 8.319666862487793, "scale": 17.64743423461914}}, "4": {"conv": {"bias": 4.434978008270264, "kernel": 157.35813903808594}, "layer_norm": {"bias": 9.193974494934082, "scale": 15.562357902526855}}, "5": {"conv": {"bias": 5.297643661499023, "kernel": 131.1835174560547}, "layer_norm": {"bias": 10.735219955444336, "scale": 13.812533378601074}}, "6": {"conv": {"bias": 5.615579128265381, "kernel": 136.41822814941406}, "layer_norm": {"bias": 12.515308380126953, "scale": 11.152680397033691}}}}, "feature_projection": {"layer_norm": {"bias": 9.220091819763184, "scale": 27.58247947692871}, "projection": {"bias": 4.322972774505615, "kernel": 88.09732818603516}}, "masked_spec_embed": 26.247730255126953}}, "train/learning_rate": 2.0205974671227978e-09, "train/loss": 0.00470846937969327, "train/param_norm": 2555.170166015625, "_timestamp": 1661922348, "_runtime": 245581, "_step": 50000, "eval/loss": 1.0609267950057983, "eval/wer": 0.043509429800374984, "eval/cer": 0.031179798652134123, "eval/step_10k": {"_type": "table-file", "sha256": "8b44e8a00a036a18ffdf81b4d076c8bf849ea6649001c69e94fa439b14f110ee", "size": 26434, "artifact_path": "wandb-client-artifact://18m0dj4hts3yiat04x5pvmncavkjapd5wb8bznb37vw8c0lqna3m2yjd1wtdrfstuoo7ejt2sphvjo0zuw1e5ne5d3qbkd7c1fylclfggig6us5tsmsj2uum5pchx48n:latest/eval/step_10k.table.json", "_latest_artifact_path": "wandb-client-artifact://18m0dj4hts3yiat04x5pvmncavkjapd5wb8bznb37vw8c0lqna3m2yjd1wtdrfstuoo7ejt2sphvjo0zuw1e5ne5d3qbkd7c1fylclfggig6us5tsmsj2uum5pchx48n:latest/eval/step_10k.table.json", "path": "media/table/eval/step_10k_10000_8b44e8a00a036a18ffdf.table.json", "ncols": 7, "nrows": 50}, "eval/step_20k": {"_type": "table-file", "sha256": "a0a50c5d8793ca99e4646f70c3624f8742c5285825bc1c59ab4083ac4de9d6e3", "size": 26657, "artifact_path": "wandb-client-artifact://13ri9hnxp93kf7dsdol2hs1j0v7bpkwwvujpi27awdck0fjm6vfog0dun9k9toif5xrt3cijlotddakikiw0bnbo3go679b4d2spq9c0w865vq0k9auiszkkbvev62fc:latest/eval/step_20k.table.json", "_latest_artifact_path": "wandb-client-artifact://13ri9hnxp93kf7dsdol2hs1j0v7bpkwwvujpi27awdck0fjm6vfog0dun9k9toif5xrt3cijlotddakikiw0bnbo3go679b4d2spq9c0w865vq0k9auiszkkbvev62fc:latest/eval/step_20k.table.json", "path": "media/table/eval/step_20k_20000_a0a50c5d8793ca99e464.table.json", "ncols": 7, "nrows": 50}, "eval/step_30k": {"_type": "table-file", "sha256": "509ad8614e16ae2800f100e82fd40356d3559e0425cf50e8e19c3155dc6c604e", "size": 26610, "artifact_path": "wandb-client-artifact://1v7mr89p2ldfoyyvrj6x6g0s8qpvgnioclm4puk5i0wphipeujkyna0xf7y63nt4a5qivkdzytt4lzhwuraoe53a5683ln1yzntyw9kh7vhcxz7oci70rpw62o1tz6ho:latest/eval/step_30k.table.json", "_latest_artifact_path": "wandb-client-artifact://1v7mr89p2ldfoyyvrj6x6g0s8qpvgnioclm4puk5i0wphipeujkyna0xf7y63nt4a5qivkdzytt4lzhwuraoe53a5683ln1yzntyw9kh7vhcxz7oci70rpw62o1tz6ho:latest/eval/step_30k.table.json", "path": "media/table/eval/step_30k_30000_509ad8614e16ae2800f1.table.json", "ncols": 7, "nrows": 50}, "eval/step_40k": {"_type": "table-file", "sha256": "1c187b6d789cca3b4ec0da0aa76f40085364204904c4e4e7f9a7ae021659a9ab", "size": 26557, "artifact_path": "wandb-client-artifact://tbhmdixx2c1ta253dre6w8pjaxb8fbzac6u2cugh4vsvvgiykum9l788fn7omfbr8f3ir5gq1fo2cb7bwlha8musehb13eb9eb7hppcmvnyc3gg5i8eprg7w7z0jqrgu:latest/eval/step_40k.table.json", "_latest_artifact_path": "wandb-client-artifact://tbhmdixx2c1ta253dre6w8pjaxb8fbzac6u2cugh4vsvvgiykum9l788fn7omfbr8f3ir5gq1fo2cb7bwlha8musehb13eb9eb7hppcmvnyc3gg5i8eprg7w7z0jqrgu:latest/eval/step_40k.table.json", "path": "media/table/eval/step_40k_40000_1c187b6d789cca3b4ec0.table.json", "ncols": 7, "nrows": 50}, "eval/step_50k": {"_type": "table-file", "sha256": "d946277550bdcac4712f096da19a0f920c9f73b3de88f034349c38d00a62401a", "size": 26122, "artifact_path": "wandb-client-artifact://14xkb9lx75lo4izjfx1i5jvdw1c2y5l5ru1s7kynrlsavcvskixfl8edb3ch4nqqjo1dan3v99tkcaqdcgsbzqu2bl2z3i9yp25hg1l2aw74ff51kg3g1dbnv585udun:latest/eval/step_50k.table.json", "_latest_artifact_path": "wandb-client-artifact://14xkb9lx75lo4izjfx1i5jvdw1c2y5l5ru1s7kynrlsavcvskixfl8edb3ch4nqqjo1dan3v99tkcaqdcgsbzqu2bl2z3i9yp25hg1l2aw74ff51kg3g1dbnv585udun:latest/eval/step_50k.table.json", "path": "media/table/eval/step_50k_50000_d946277550bdcac4712f.table.json", "ncols": 7, "nrows": 50}, "eval/step_50k_all": {"_type": "table-file", "sha256": "d133c219f8e819721cc034248ad6ce72cb0f883b9dd7c745517f7e6afd709dc2", "size": 1847035, "artifact_path": "wandb-client-artifact://mczsb9qym8ovamixtxbuv18kn3ptjrel57upfc55hrguv95nh6duahthlgiol00im0cmce06jpjbmvm949ucla8z7u75ok0pbg585cp5z4gmdgl9ktcgh2cpv7ao2qaj:latest/eval/step_50k_all.table.json", "_latest_artifact_path": "wandb-client-artifact://mczsb9qym8ovamixtxbuv18kn3ptjrel57upfc55hrguv95nh6duahthlgiol00im0cmce06jpjbmvm949ucla8z7u75ok0pbg585cp5z4gmdgl9ktcgh2cpv7ao2qaj:latest/eval/step_50k_all.table.json", "path": "media/table/eval/step_50k_all_50000_d133c219f8e819721cc0.table.json", "ncols": 7, "nrows": 2703}, "eval/step_50k_incorrect": {"_type": "table-file", "sha256": "0cdf712b022638152e8a5f2dcb0d393ca4532e7851af758fa87cb708284226b2", "size": 716628, "artifact_path": "wandb-client-artifact://5aifducq9kgyr06jw3bhk95fnsbfbnf1uah6tvnht4g1s2a2ng954ta81v2071j98kus5hizzur3r9ub0d0fjy7d4dxl7fvffe9dblejd2lnejx2x8rdzybe4hp4fjhf:latest/eval/step_50k_incorrect.table.json", "_latest_artifact_path": "wandb-client-artifact://5aifducq9kgyr06jw3bhk95fnsbfbnf1uah6tvnht4g1s2a2ng954ta81v2071j98kus5hizzur3r9ub0d0fjy7d4dxl7fvffe9dblejd2lnejx2x8rdzybe4hp4fjhf:latest/eval/step_50k_incorrect.table.json", "path": "media/table/eval/step_50k_incorrect_50000_0cdf712b022638152e8a.table.json", "ncols": 7, "nrows": 811}, "validation.other/loss": 1.3155505657196045, "validation.other/wer": 0.07554761717829944, "validation.other/cer": 0.04917447198920102, "validation.other/step_50k": {"_type": "table-file", "sha256": "6fcf279cf374320c0391bc383b4f1c3b05e85b1e94a084311e7e0b2b641c7a52", "size": 28386, "artifact_path": "wandb-client-artifact://q9cv3pxqlr3pzuirswid7b1iku9wz9nn03s7s7kjpulvw2ddw71x528t02cbynzc06yl6v3l6b94asex2j7ge7i2qal71ujqx48renom32utpgjhbrk5ibpdhna18jsy:latest/validation.other/step_50k.table.json", "_latest_artifact_path": "wandb-client-artifact://q9cv3pxqlr3pzuirswid7b1iku9wz9nn03s7s7kjpulvw2ddw71x528t02cbynzc06yl6v3l6b94asex2j7ge7i2qal71ujqx48renom32utpgjhbrk5ibpdhna18jsy:latest/validation.other/step_50k.table.json", "path": "media/table/validation.other/step_50k_50000_6fcf279cf374320c0391.table.json", "ncols": 7, "nrows": 50}, "validation.other/step_50k_all": {"_type": "table-file", "sha256": "76416d8d0ada18306d51fdfdc311bb4790b2a529009f596634bdb7270dd67a15", "size": 1721592, "artifact_path": "wandb-client-artifact://wy6qjlq7v2xerxehv91rh9cnega79yhas5cwr11au887abxrq03i3b20pp0me4emi3t85xsmtzya43sihjlftfpmpidzwh9bobphcb0p5ctot5y7a7n502jvjqww1dth:latest/validation.other/step_50k_all.table.json", "_latest_artifact_path": "wandb-client-artifact://wy6qjlq7v2xerxehv91rh9cnega79yhas5cwr11au887abxrq03i3b20pp0me4emi3t85xsmtzya43sihjlftfpmpidzwh9bobphcb0p5ctot5y7a7n502jvjqww1dth:latest/validation.other/step_50k_all.table.json", "path": "media/table/validation.other/step_50k_all_50000_76416d8d0ada18306d51.table.json", "ncols": 7, "nrows": 2864}, "validation.other/step_50k_incorrect": {"_type": "table-file", "sha256": "6a1bcf9183eee40f9304d05a9ddf952ff39c4c1bbef36718e54fcef6f0477218", "size": 887471, "artifact_path": "wandb-client-artifact://11mvooo847miabg4dgoavd3om2popvk50fs28txa4m3804z12wyo9njf65q56kfxubtji9lviuq965gyz92rcuzgi1sf1932z7nk76b0z6lu8vm4azv5ltdp88f4mob6:latest/validation.other/step_50k_incorrect.table.json", "_latest_artifact_path": "wandb-client-artifact://11mvooo847miabg4dgoavd3om2popvk50fs28txa4m3804z12wyo9njf65q56kfxubtji9lviuq965gyz92rcuzgi1sf1932z7nk76b0z6lu8vm4azv5ltdp88f4mob6:latest/validation.other/step_50k_incorrect.table.json", "path": "media/table/validation.other/step_50k_incorrect_50000_6a1bcf9183eee40f9304.table.json", "ncols": 7, "nrows": 1269}, "test.clean/loss": 0.4645487070083618, "test.clean/wer": 0.04589546561168594, "test.clean/cer": 0.032518736901928746, "test.clean/step_50k": {"_type": "table-file", "sha256": "d5fafb8dd177f43952e40911b387c61d0f0de6e30d2f45281e3c52042356270b", "size": 34757, "artifact_path": "wandb-client-artifact://190yf2juu775o1c7ot8q1n52vimqek75an02dhaoubdi23v13ramf4xfx8hfkfbx1lwap2wdcsjutf9c3of1dl47ghnckxen8ebpivred1kymkkrqno3i6maiwme7yww:latest/test.clean/step_50k.table.json", "_latest_artifact_path": "wandb-client-artifact://190yf2juu775o1c7ot8q1n52vimqek75an02dhaoubdi23v13ramf4xfx8hfkfbx1lwap2wdcsjutf9c3of1dl47ghnckxen8ebpivred1kymkkrqno3i6maiwme7yww:latest/test.clean/step_50k.table.json", "path": "media/table/test.clean/step_50k_50000_d5fafb8dd177f43952e4.table.json", "ncols": 7, "nrows": 50}, "test.clean/step_50k_all": {"_type": "table-file", "sha256": "4c7620847b0f2c209a07c2ad291d76c98c446cd5a9a9f674688be0eef065cbe6", "size": 1801529, "artifact_path": "wandb-client-artifact://2y5r3i116gk3acj38jaji4us6e0pttbtylfvh0xzjc37gqobxllpig4jafyza890obfw0r6cqvn64wy1pjoubc5hso29cq44z6hzn9hyrdt1poo8l7cavdcoxnedlinj:latest/test.clean/step_50k_all.table.json", "_latest_artifact_path": "wandb-client-artifact://2y5r3i116gk3acj38jaji4us6e0pttbtylfvh0xzjc37gqobxllpig4jafyza890obfw0r6cqvn64wy1pjoubc5hso29cq44z6hzn9hyrdt1poo8l7cavdcoxnedlinj:latest/test.clean/step_50k_all.table.json", "path": "media/table/test.clean/step_50k_all_50000_4c7620847b0f2c209a07.table.json", "ncols": 7, "nrows": 2620}, "test.clean/step_50k_incorrect": {"_type": "table-file", "sha256": "3cef5387798fe343fd47054443825ad553f259be09b32c58cdf27f151c65f270", "size": 692556, "artifact_path": "wandb-client-artifact://p1viwn4qsfuwe8aqmtf3f8lbs14zh8qqyw50z1ygp1r2phz4ax2altpceoyg9lysqny3ej5gi3s7jwx02x00qv7o5d4y44nbsn0b6vp8kec7lltdhud53bs0owo0v1ja:latest/test.clean/step_50k_incorrect.table.json", "_latest_artifact_path": "wandb-client-artifact://p1viwn4qsfuwe8aqmtf3f8lbs14zh8qqyw50z1ygp1r2phz4ax2altpceoyg9lysqny3ej5gi3s7jwx02x00qv7o5d4y44nbsn0b6vp8kec7lltdhud53bs0owo0v1ja:latest/test.clean/step_50k_incorrect.table.json", "path": "media/table/test.clean/step_50k_incorrect_50000_3cef5387798fe343fd47.table.json", "ncols": 7, "nrows": 772}, "_wandb": {"runtime": 246094}}

wandb/run-20220828_085247-2hx8pk65/logs/debug-internal.log

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1f80a39e659e1401a6be03c1a16ddc1e34a04ddabd64c6c956b346c7ad49ffd6
-size 17019871
+oid sha256:5486629b54888669c10a5deff07b1863585f405696bcdf65d34fa91c96a8c099
+size 17181631

wandb/run-20220828_085247-2hx8pk65/logs/debug.log

@@ -23,3 +23,163 @@ config: {}
 2022-08-28 08:52:48,583 INFO    MainThread:53859 [wandb_run.py:_redirect():1775] Redirecting console.
 2022-08-28 08:52:48,585 INFO    MainThread:53859 [wandb_run.py:_redirect():1831] Redirects installed.
 2022-08-28 08:52:48,585 INFO    MainThread:53859 [wandb_init.py:init():684] run started, returning control to user process
+2022-08-31 05:14:20,857 INFO    MainThread:53859 [wandb_run.py:_atexit_cleanup():1866] got exitcode: 1
+2022-08-31 05:14:20,861 INFO    MainThread:53859 [wandb_run.py:_restore():1838] restore
+2022-08-31 05:14:23,260 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 1
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 15739758
+  total_bytes: 15739758
+}
+
+2022-08-31 05:14:23,362 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 1
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 15739758
+  total_bytes: 15739758
+}
+
+2022-08-31 05:14:23,540 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 1
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 15739758
+  total_bytes: 15739758
+}
+
+2022-08-31 05:14:24,438 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 5
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 15739758
+  total_bytes: 16288186
+}
+
+2022-08-31 05:14:24,543 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 5
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 15739758
+  total_bytes: 16288186
+}
+
+2022-08-31 05:14:24,645 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 5
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 16288186
+  total_bytes: 16288186
+}
+
+2022-08-31 05:14:24,747 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 5
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 16288186
+  total_bytes: 16288186
+}
+
+2022-08-31 05:14:24,848 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 5
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 16288186
+  total_bytes: 16288186
+}
+
+2022-08-31 05:14:24,950 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 5
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 16288186
+  total_bytes: 16288186
+}
+
+2022-08-31 05:14:25,052 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 5
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 16288186
+  total_bytes: 16288186
+}
+
+2022-08-31 05:14:25,154 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 5
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 16288186
+  total_bytes: 16288186
+}
+
+2022-08-31 05:14:25,256 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 5
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 16288186
+  total_bytes: 16288186
+}
+
+2022-08-31 05:14:25,357 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 5
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 16288186
+  total_bytes: 16288186
+}
+
+2022-08-31 05:14:25,889 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
+  wandb_count: 5
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 16288186
+  total_bytes: 16288186
+}
+
+2022-08-31 05:14:26,122 INFO    MainThread:53859 [wandb_run.py:_on_finish():1995] got exit ret: done: true
+exit_result {
+}
+file_counts {
+  wandb_count: 5
+  media_count: 13
+  artifact_count: 13
+}
+pusher_stats {
+  uploaded_bytes: 16288186
+  total_bytes: 16288186
+}
+local_info {
+}
+
+2022-08-31 05:14:27,485 INFO    MainThread:53859 [wandb_run.py:_footer_history_summary_info():3102] rendering history
+2022-08-31 05:14:27,487 INFO    MainThread:53859 [wandb_run.py:_footer_history_summary_info():3134] rendering summary
+2022-08-31 05:14:27,489 INFO    MainThread:53859 [wandb_run.py:_footer_sync_info():3057] logging synced files

wandb/run-20220828_085247-2hx8pk65/run-2hx8pk65.wandb

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4091a31807c620f1680b2cbc9c2340da78bef2667936aaabb64b632931b7b707
-size 21371807
+oid sha256:8b35a31c0e0328aace1c4fde52edbaf572ae6e7804bf24a1815f5aa23742acb8
+size 21556084