cahya commited on
Commit
df53f6a
β€’
1 Parent(s): b555d05

Saving weights and logs of step 90

Browse files
events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c7e95ab95fada1a72ddfeb81eb1799ed825c0c3ce91393c178ac2020b875dc4c
3
- size 1160
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3a4a0caeae4a73256a5843cb07a04240918499c43a5616a17cd922d9c6fc2d7
3
+ size 1300
flax_model.msgpack CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d99736d858195bbfbc635b361d3bc3606facce7df988763ff697e7368ba743ef
3
  size 1419302302
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9401c601624d6a7df81080a28c95b2d12fa4590419623d4c6eeab34df2fb1361
3
  size 1419302302
wandb/run-20210709_141445-2k8cnty2/files/output.log CHANGED
@@ -511,3 +511,11 @@ Training...: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
511
  Evaluating...: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3/5 [00:06<00:02, 1.42s/it]
512
 
513
 
 
 
 
 
 
 
 
 
 
511
  Evaluating...: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3/5 [00:06<00:02, 1.42s/it]
512
 
513
 
514
+ Model weights saved in /home/cahya/Work/flax-community/gpt2-medium-indonesian/flax_model.msgpackβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 28/52 [03:05<00:45, 1.90s/it]
515
+ Model pushed to the hub in this commit: https://huggingface.co/flax-community/gpt2-medium-indonesian/commit/b555d05b45c7614de4191feb6c29b1b091df7787
516
+
517
+
518
+ Training...: 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 38/52 [04:19<00:25, 1.80s/it]
519
+
520
+ Evaluating...: 0%| | 0/5 [00:00<?, ?it/s]
521
+
wandb/run-20210709_141445-2k8cnty2/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"global_step": 70, "_timestamp": 1625840693.228476, "eval_loss": 7.895484924316406, "eval_perplexity": 2685.13134765625, "_step": 6}
 
1
+ {"global_step": 80, "_timestamp": 1625840784.417943, "eval_loss": 7.80868673324585, "eval_perplexity": 2461.895263671875, "_step": 7}
wandb/run-20210709_141445-2k8cnty2/logs/debug-internal.log CHANGED
@@ -277,3 +277,30 @@
277
  2021-07-09 14:26:42,104 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
278
  2021-07-09 14:26:44,587 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
279
  2021-07-09 14:26:47,351 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
277
  2021-07-09 14:26:42,104 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
278
  2021-07-09 14:26:44,587 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
279
  2021-07-09 14:26:47,351 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
280
+ 2021-07-09 14:26:57,242 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
281
+ 2021-07-09 14:26:57,242 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
282
+ 2021-07-09 14:27:12,371 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
283
+ 2021-07-09 14:27:12,372 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
284
+ 2021-07-09 14:27:17,427 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
285
+ 2021-07-09 14:27:27,503 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
286
+ 2021-07-09 14:27:27,504 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
287
+ 2021-07-09 14:27:36,610 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
288
+ 2021-07-09 14:27:38,611 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
289
+ 2021-07-09 14:27:40,612 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
290
+ 2021-07-09 14:27:42,613 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
291
+ 2021-07-09 14:27:42,635 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
292
+ 2021-07-09 14:27:42,636 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
293
+ 2021-07-09 14:27:47,505 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
294
+ 2021-07-09 14:27:47,615 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2
295
+ 2021-07-09 14:27:47,684 DEBUG SenderThread:246776 [sender.py:send():179] send: history
296
+ 2021-07-09 14:27:47,684 DEBUG SenderThread:246776 [sender.py:send():179] send: summary
297
+ 2021-07-09 14:27:47,684 INFO SenderThread:246776 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
298
+ 2021-07-09 14:27:48,086 INFO Thread-20 :246776 [upload_job.py:push():137] Uploaded file /tmp/tmp4f0a6i2mwandb/196d2q98-events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2
299
+ 2021-07-09 14:27:48,616 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
300
+ 2021-07-09 14:27:48,616 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/wandb-summary.json
301
+ 2021-07-09 14:27:50,617 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
302
+ 2021-07-09 14:27:57,771 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
303
+ 2021-07-09 14:27:57,771 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
304
+ 2021-07-09 14:28:06,624 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
305
+ 2021-07-09 14:28:12,907 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
306
+ 2021-07-09 14:28:12,907 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb CHANGED
Binary files a/wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb and b/wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb differ