cahya commited on
Commit
bfedc8c
β€’
1 Parent(s): 5909771

Saving weights and logs of step 70

Browse files
events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:52f046eab37f4feeda40355e6629d6ea954ca351d66715bc06ff3e96c87e213a
3
- size 880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7498c2f5cb49bbe93b52f484d001f66b519b61ce21a1072e0853bd792c747e1
3
+ size 1020
flax_model.msgpack CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c3fa321a360e2392a36d7af2e43abd3dfb7f9472072fda993fdbf9bc4fa4d22b
3
  size 1419302302
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2205bfa3e7d4a2dd0ad5f99ad3a77dc740cf21c41c6de86996ebd8640cec3cb
3
  size 1419302302
wandb/run-20210709_141445-2k8cnty2/files/output.log CHANGED
@@ -495,3 +495,11 @@ Training...: 15%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
495
  Evaluating...: 20%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 1/5 [00:05<00:22, 5.71s/it]
496
 
497
 
 
 
 
 
 
 
 
 
 
495
  Evaluating...: 20%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 1/5 [00:05<00:22, 5.71s/it]
496
 
497
 
498
+ Model weights saved in /home/cahya/Work/flax-community/gpt2-medium-indonesian/flax_model.msgpack | 8/52 [00:11<00:31, 1.42it/s]
499
+ Model pushed to the hub in this commit: https://huggingface.co/flax-community/gpt2-medium-indonesian/commit/5909771ac8627d126412dd5be1ce45591cab49bb
500
+
501
+ Training...: 35%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 18/52 [01:25<00:59, 1.75s/it]
502
+
503
+ Evaluating...: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 4/5 [00:06<00:00, 1.07it/s]
504
+
505
+
wandb/run-20210709_141445-2k8cnty2/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"global_step": 50, "_timestamp": 1625840527.595528, "eval_loss": 8.027718544006348, "eval_perplexity": 3064.74169921875, "_step": 4}
 
1
+ {"global_step": 60, "_timestamp": 1625840611.232235, "eval_loss": 7.941996097564697, "eval_perplexity": 2812.969970703125, "_step": 5}
wandb/run-20210709_141445-2k8cnty2/logs/debug-internal.log CHANGED
@@ -225,3 +225,29 @@
225
  2021-07-09 14:23:50,514 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
226
  2021-07-09 14:23:55,122 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
227
  2021-07-09 14:23:55,122 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
225
  2021-07-09 14:23:50,514 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
226
  2021-07-09 14:23:55,122 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
227
  2021-07-09 14:23:55,122 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
228
+ 2021-07-09 14:24:10,254 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
229
+ 2021-07-09 14:24:10,254 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
230
+ 2021-07-09 14:24:16,957 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
231
+ 2021-07-09 14:24:25,385 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
232
+ 2021-07-09 14:24:25,385 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
233
+ 2021-07-09 14:24:40,609 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
234
+ 2021-07-09 14:24:40,609 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
235
+ 2021-07-09 14:24:42,535 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
236
+ 2021-07-09 14:24:44,536 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
237
+ 2021-07-09 14:24:46,536 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
238
+ 2021-07-09 14:24:47,034 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
239
+ 2021-07-09 14:24:52,539 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
240
+ 2021-07-09 14:24:53,395 DEBUG SenderThread:246776 [sender.py:send():179] send: history
241
+ 2021-07-09 14:24:53,395 DEBUG SenderThread:246776 [sender.py:send():179] send: summary
242
+ 2021-07-09 14:24:53,395 INFO SenderThread:246776 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
243
+ 2021-07-09 14:24:53,539 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2
244
+ 2021-07-09 14:24:53,540 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/wandb-summary.json
245
+ 2021-07-09 14:24:54,013 INFO Thread-19 :246776 [upload_job.py:push():137] Uploaded file /tmp/tmp4f0a6i2mwandb/72n81odb-events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2
246
+ 2021-07-09 14:24:54,540 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
247
+ 2021-07-09 14:24:55,540 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
248
+ 2021-07-09 14:24:55,836 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
249
+ 2021-07-09 14:24:55,836 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
250
+ 2021-07-09 14:25:10,974 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
251
+ 2021-07-09 14:25:10,974 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
252
+ 2021-07-09 14:25:13,548 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
253
+ 2021-07-09 14:25:17,112 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb CHANGED
Binary files a/wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb and b/wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb differ