Saving weights and logs of step 60
Browse files- events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2 +2 -2
- flax_model.msgpack +1 -1
- wandb/run-20210709_141445-2k8cnty2/files/output.log +10 -0
- wandb/run-20210709_141445-2k8cnty2/files/wandb-summary.json +1 -1
- wandb/run-20210709_141445-2k8cnty2/logs/debug-internal.log +27 -0
- wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb +0 -0
events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:52f046eab37f4feeda40355e6629d6ea954ca351d66715bc06ff3e96c87e213a
|
3 |
+
size 880
|
flax_model.msgpack
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 1419302302
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c3fa321a360e2392a36d7af2e43abd3dfb7f9472072fda993fdbf9bc4fa4d22b
|
3 |
size 1419302302
|
wandb/run-20210709_141445-2k8cnty2/files/output.log
CHANGED
@@ -485,3 +485,13 @@ Evaluating...: 0%|
|
|
485 |
|
486 |
|
487 |
tcmalloc: large alloc 2426904576 bytes == 0x56396efea000 @ 0x7faff8cbc680 0x7faff8cdcbdd 0x7faca7dcf20d 0x7faca7ddd340 0x7faca7ddce87 0x7faca7ddce87 0x7faca7ddce87 0x7faca7dd8bd3 0x7faca7dd91fe 0x56364a10452a 0x56364a0cb254 0x56364a11c9c9 0x56364a11d85f 0x56364a0cacc7 0x56364a11d768 0x56364a0cae14 0x56364a11d768 0x56364a0cae14 0x56364a11d066 0x56364a1284c6 0x56364a0cacc7 0x56364a11d132 0x56364a11d7fb 0x56364a0cae14 0x56364a11c9c9 0x56364a17c383 0x56364a17c8d2 0x56364a18c982 0x56364a18e429 0x56364a18e60f 0x56364a18ea09
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
485 |
|
486 |
|
487 |
tcmalloc: large alloc 2426904576 bytes == 0x56396efea000 @ 0x7faff8cbc680 0x7faff8cdcbdd 0x7faca7dcf20d 0x7faca7ddd340 0x7faca7ddce87 0x7faca7ddce87 0x7faca7ddce87 0x7faca7dd8bd3 0x7faca7dd91fe 0x56364a10452a 0x56364a0cb254 0x56364a11c9c9 0x56364a11d85f 0x56364a0cacc7 0x56364a11d768 0x56364a0cae14 0x56364a11d768 0x56364a0cae14 0x56364a11d066 0x56364a1284c6 0x56364a0cacc7 0x56364a11d132 0x56364a11d7fb 0x56364a0cae14 0x56364a11c9c9 0x56364a17c383 0x56364a17c8d2 0x56364a18c982 0x56364a18e429 0x56364a18e60f 0x56364a18ea09
|
488 |
+
Model weights saved in /home/cahya/Work/flax-community/gpt2-medium-indonesian/flax_model.msgpack
|
489 |
+
Model pushed to the hub in this commit: https://huggingface.co/flax-community/gpt2-medium-indonesian/commit/e5892f9edde10ba88e7e357bb4afb2d94a162a9b
|
490 |
+
Step... (50 | Eval Loss: 8.027718544006348 | Eval Perplexity: 3064.7416180159676): 5%|βββββββ | 1/20 [07:49<2:28:42, 469.59s/it]
|
491 |
+
|
492 |
+
|
493 |
+
Training...: 15%|βββββββββββββββββββββββββββββββ | 8/52 [00:03<00:31, 1.42it/s]
|
494 |
+
|
495 |
+
Evaluating...: 20%|βββββββββββββββββββββββββββββββββββββββ | 1/5 [00:05<00:22, 5.71s/it]
|
496 |
+
|
497 |
+
|
wandb/run-20210709_141445-2k8cnty2/files/wandb-summary.json
CHANGED
@@ -1 +1 @@
|
|
1 |
-
{"global_step":
|
|
|
1 |
+
{"global_step": 50, "_timestamp": 1625840527.595528, "eval_loss": 8.027718544006348, "eval_perplexity": 3064.74169921875, "_step": 4}
|
wandb/run-20210709_141445-2k8cnty2/logs/debug-internal.log
CHANGED
@@ -198,3 +198,30 @@
|
|
198 |
2021-07-09 14:22:24,304 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
|
199 |
2021-07-09 14:22:24,304 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
|
200 |
2021-07-09 14:22:28,478 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
198 |
2021-07-09 14:22:24,304 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
|
199 |
2021-07-09 14:22:24,304 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
|
200 |
2021-07-09 14:22:28,478 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
|
201 |
+
2021-07-09 14:22:39,446 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
|
202 |
+
2021-07-09 14:22:39,447 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
|
203 |
+
2021-07-09 14:22:46,723 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
|
204 |
+
2021-07-09 14:22:54,575 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
|
205 |
+
2021-07-09 14:22:54,575 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
|
206 |
+
2021-07-09 14:23:09,708 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
|
207 |
+
2021-07-09 14:23:09,708 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
|
208 |
+
2021-07-09 14:23:16,801 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
|
209 |
+
2021-07-09 14:23:20,500 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
|
210 |
+
2021-07-09 14:23:22,501 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
|
211 |
+
2021-07-09 14:23:24,502 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
|
212 |
+
2021-07-09 14:23:24,837 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
|
213 |
+
2021-07-09 14:23:24,838 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
|
214 |
+
2021-07-09 14:23:26,503 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
|
215 |
+
2021-07-09 14:23:30,505 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
|
216 |
+
2021-07-09 14:23:31,259 DEBUG SenderThread:246776 [sender.py:send():179] send: history
|
217 |
+
2021-07-09 14:23:31,259 DEBUG SenderThread:246776 [sender.py:send():179] send: summary
|
218 |
+
2021-07-09 14:23:31,260 INFO SenderThread:246776 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
219 |
+
2021-07-09 14:23:31,505 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2
|
220 |
+
2021-07-09 14:23:31,506 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/wandb-summary.json
|
221 |
+
2021-07-09 14:23:32,506 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
|
222 |
+
2021-07-09 14:23:39,978 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
|
223 |
+
2021-07-09 14:23:39,979 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
|
224 |
+
2021-07-09 14:23:46,879 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
|
225 |
+
2021-07-09 14:23:50,514 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
|
226 |
+
2021-07-09 14:23:55,122 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
|
227 |
+
2021-07-09 14:23:55,122 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
|
wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb
CHANGED
Binary files a/wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb and b/wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb differ
|
|