cahya commited on
Commit
b555d05
β€’
1 Parent(s): bfedc8c

Saving weights and logs of step 80

Browse files
events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c7498c2f5cb49bbe93b52f484d001f66b519b61ce21a1072e0853bd792c747e1
3
- size 1020
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7e95ab95fada1a72ddfeb81eb1799ed825c0c3ce91393c178ac2020b875dc4c
3
+ size 1160
flax_model.msgpack CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e2205bfa3e7d4a2dd0ad5f99ad3a77dc740cf21c41c6de86996ebd8640cec3cb
3
  size 1419302302
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d99736d858195bbfbc635b361d3bc3606facce7df988763ff697e7368ba743ef
3
  size 1419302302
wandb/run-20210709_141445-2k8cnty2/files/output.log CHANGED
@@ -503,3 +503,11 @@ Training...: 35%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
503
  Evaluating...: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 4/5 [00:06<00:00, 1.07it/s]
504
 
505
 
 
 
 
 
 
 
 
 
 
503
  Evaluating...: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 4/5 [00:06<00:00, 1.07it/s]
504
 
505
 
506
+ Model weights saved in /home/cahya/Work/flax-community/gpt2-medium-indonesian/flax_model.msgpack | 18/52 [01:33<00:59, 1.75s/it]
507
+ Model pushed to the hub in this commit: https://huggingface.co/flax-community/gpt2-medium-indonesian/commit/bfedc8ccf558423d0844ac51a3dc57f4d9e34e6b
508
+
509
+ Training...: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 28/52 [02:56<00:45, 1.90s/it]
510
+
511
+ Evaluating...: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3/5 [00:06<00:02, 1.42s/it]
512
+
513
+
wandb/run-20210709_141445-2k8cnty2/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"global_step": 60, "_timestamp": 1625840611.232235, "eval_loss": 7.941996097564697, "eval_perplexity": 2812.969970703125, "_step": 5}
 
1
+ {"global_step": 70, "_timestamp": 1625840693.228476, "eval_loss": 7.895484924316406, "eval_perplexity": 2685.13134765625, "_step": 6}
wandb/run-20210709_141445-2k8cnty2/logs/debug-internal.log CHANGED
@@ -251,3 +251,29 @@
251
  2021-07-09 14:25:10,974 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
252
  2021-07-09 14:25:13,548 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
253
  2021-07-09 14:25:17,112 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
251
  2021-07-09 14:25:10,974 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
252
  2021-07-09 14:25:13,548 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
253
  2021-07-09 14:25:17,112 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
254
+ 2021-07-09 14:25:26,143 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
255
+ 2021-07-09 14:25:26,144 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
256
+ 2021-07-09 14:25:41,276 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
257
+ 2021-07-09 14:25:41,276 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
258
+ 2021-07-09 14:25:47,189 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
259
+ 2021-07-09 14:25:56,420 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
260
+ 2021-07-09 14:25:56,420 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
261
+ 2021-07-09 14:26:11,570 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
262
+ 2021-07-09 14:26:11,570 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
263
+ 2021-07-09 14:26:13,573 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
264
+ 2021-07-09 14:26:15,574 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
265
+ 2021-07-09 14:26:17,268 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
266
+ 2021-07-09 14:26:17,575 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
267
+ 2021-07-09 14:26:23,578 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
268
+ 2021-07-09 14:26:24,547 DEBUG SenderThread:246776 [sender.py:send():179] send: history
269
+ 2021-07-09 14:26:24,547 DEBUG SenderThread:246776 [sender.py:send():179] send: summary
270
+ 2021-07-09 14:26:24,548 INFO SenderThread:246776 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
271
+ 2021-07-09 14:26:24,578 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2
272
+ 2021-07-09 14:26:24,578 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/wandb-summary.json
273
+ 2021-07-09 14:26:25,579 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
274
+ 2021-07-09 14:26:26,793 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
275
+ 2021-07-09 14:26:26,794 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
276
+ 2021-07-09 14:26:42,104 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
277
+ 2021-07-09 14:26:42,104 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
278
+ 2021-07-09 14:26:44,587 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
279
+ 2021-07-09 14:26:47,351 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb CHANGED
Binary files a/wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb and b/wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb differ