cahya commited on
Commit
5909771
β€’
1 Parent(s): e5892f9

Saving weights and logs of step 60

Browse files
events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:29127ff00a5abb5eced7951908274665a9e0884b0e11a56e7587706a835ed86b
3
- size 740
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52f046eab37f4feeda40355e6629d6ea954ca351d66715bc06ff3e96c87e213a
3
+ size 880
flax_model.msgpack CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7d2e5440f36a01e368586fdd77a1ab6a8745b8d0b1a7dd09510558e9905e4c3f
3
  size 1419302302
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3fa321a360e2392a36d7af2e43abd3dfb7f9472072fda993fdbf9bc4fa4d22b
3
  size 1419302302
wandb/run-20210709_141445-2k8cnty2/files/output.log CHANGED
@@ -485,3 +485,13 @@ Evaluating...: 0%|
485
 
486
 
487
  tcmalloc: large alloc 2426904576 bytes == 0x56396efea000 @ 0x7faff8cbc680 0x7faff8cdcbdd 0x7faca7dcf20d 0x7faca7ddd340 0x7faca7ddce87 0x7faca7ddce87 0x7faca7ddce87 0x7faca7dd8bd3 0x7faca7dd91fe 0x56364a10452a 0x56364a0cb254 0x56364a11c9c9 0x56364a11d85f 0x56364a0cacc7 0x56364a11d768 0x56364a0cae14 0x56364a11d768 0x56364a0cae14 0x56364a11d066 0x56364a1284c6 0x56364a0cacc7 0x56364a11d132 0x56364a11d7fb 0x56364a0cae14 0x56364a11c9c9 0x56364a17c383 0x56364a17c8d2 0x56364a18c982 0x56364a18e429 0x56364a18e60f 0x56364a18ea09
 
 
 
 
 
 
 
 
 
 
 
485
 
486
 
487
  tcmalloc: large alloc 2426904576 bytes == 0x56396efea000 @ 0x7faff8cbc680 0x7faff8cdcbdd 0x7faca7dcf20d 0x7faca7ddd340 0x7faca7ddce87 0x7faca7ddce87 0x7faca7ddce87 0x7faca7dd8bd3 0x7faca7dd91fe 0x56364a10452a 0x56364a0cb254 0x56364a11c9c9 0x56364a11d85f 0x56364a0cacc7 0x56364a11d768 0x56364a0cae14 0x56364a11d768 0x56364a0cae14 0x56364a11d066 0x56364a1284c6 0x56364a0cacc7 0x56364a11d132 0x56364a11d7fb 0x56364a0cae14 0x56364a11c9c9 0x56364a17c383 0x56364a17c8d2 0x56364a18c982 0x56364a18e429 0x56364a18e60f 0x56364a18ea09
488
+ Model weights saved in /home/cahya/Work/flax-community/gpt2-medium-indonesian/flax_model.msgpack
489
+ Model pushed to the hub in this commit: https://huggingface.co/flax-community/gpt2-medium-indonesian/commit/e5892f9edde10ba88e7e357bb4afb2d94a162a9b
490
+ Step... (50 | Eval Loss: 8.027718544006348 | Eval Perplexity: 3064.7416180159676): 5%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 1/20 [07:49<2:28:42, 469.59s/it]
491
+
492
+
493
+ Training...: 15%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 8/52 [00:03<00:31, 1.42it/s]
494
+
495
+ Evaluating...: 20%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 1/5 [00:05<00:22, 5.71s/it]
496
+
497
+
wandb/run-20210709_141445-2k8cnty2/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"global_step": 40, "_timestamp": 1625840437.50007, "eval_loss": 8.340357780456543, "eval_perplexity": 4189.58837890625, "_step": 3}
 
1
+ {"global_step": 50, "_timestamp": 1625840527.595528, "eval_loss": 8.027718544006348, "eval_perplexity": 3064.74169921875, "_step": 4}
wandb/run-20210709_141445-2k8cnty2/logs/debug-internal.log CHANGED
@@ -198,3 +198,30 @@
198
  2021-07-09 14:22:24,304 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
199
  2021-07-09 14:22:24,304 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
200
  2021-07-09 14:22:28,478 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
198
  2021-07-09 14:22:24,304 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
199
  2021-07-09 14:22:24,304 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
200
  2021-07-09 14:22:28,478 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
201
+ 2021-07-09 14:22:39,446 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
202
+ 2021-07-09 14:22:39,447 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
203
+ 2021-07-09 14:22:46,723 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
204
+ 2021-07-09 14:22:54,575 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
205
+ 2021-07-09 14:22:54,575 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
206
+ 2021-07-09 14:23:09,708 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
207
+ 2021-07-09 14:23:09,708 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
208
+ 2021-07-09 14:23:16,801 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
209
+ 2021-07-09 14:23:20,500 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
210
+ 2021-07-09 14:23:22,501 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
211
+ 2021-07-09 14:23:24,502 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
212
+ 2021-07-09 14:23:24,837 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
213
+ 2021-07-09 14:23:24,838 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
214
+ 2021-07-09 14:23:26,503 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
215
+ 2021-07-09 14:23:30,505 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
216
+ 2021-07-09 14:23:31,259 DEBUG SenderThread:246776 [sender.py:send():179] send: history
217
+ 2021-07-09 14:23:31,259 DEBUG SenderThread:246776 [sender.py:send():179] send: summary
218
+ 2021-07-09 14:23:31,260 INFO SenderThread:246776 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
219
+ 2021-07-09 14:23:31,505 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/events.out.tfevents.1625840127.t1v-n-528d9406-w-0.245719.3.v2
220
+ 2021-07-09 14:23:31,506 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/wandb-summary.json
221
+ 2021-07-09 14:23:32,506 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
222
+ 2021-07-09 14:23:39,978 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
223
+ 2021-07-09 14:23:39,979 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
224
+ 2021-07-09 14:23:46,879 DEBUG SenderThread:246776 [sender.py:send():179] send: stats
225
+ 2021-07-09 14:23:50,514 INFO Thread-8 :246776 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/cahya/Work/flax-community/gpt2-medium-indonesian/wandb/run-20210709_141445-2k8cnty2/files/output.log
226
+ 2021-07-09 14:23:55,122 DEBUG HandlerThread:246776 [handler.py:handle_request():124] handle_request: stop_status
227
+ 2021-07-09 14:23:55,122 DEBUG SenderThread:246776 [sender.py:send_request():193] send_request: stop_status
wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb CHANGED
Binary files a/wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb and b/wandb/run-20210709_141445-2k8cnty2/run-2k8cnty2.wandb differ