Femboyuwu2000 commited on
Commit
365c00b
1 Parent(s): c648498

Training in progress, step 5680

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:551f265b0824afe04aca693b6dea37fd5b135be5b8dccb283b485991e4dad3cf
3
  size 13982248
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f642b7272fb3c43757e0dd7757c768e666b6467cc9ba7639d11a06d2d775a4af
3
  size 13982248
runs/Apr12_07-40-41_e5a48bec8248/events.out.tfevents.1712907642.e5a48bec8248.443.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d5816308c835b4dc01c066025e3a9c92c0c72f462b2a6da74e9e5aa3b7c34c3e
3
- size 64549
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9367deb0003983c23ef2d26b6a6b5693b755eda0a70cc9a4721bed3b5ac959d
3
+ size 65182
wandb/debug-internal.log CHANGED
@@ -4666,3 +4666,53 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
4666
  2024-04-12 09:35:32,391 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4667
  2024-04-12 09:35:32,392 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4668
  2024-04-12 09:35:32,530 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4666
  2024-04-12 09:35:32,391 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4667
  2024-04-12 09:35:32,392 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4668
  2024-04-12 09:35:32,530 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4669
+ 2024-04-12 09:35:33,785 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4670
+ 2024-04-12 09:35:37,531 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4671
+ 2024-04-12 09:35:42,532 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4672
+ 2024-04-12 09:35:45,270 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4673
+ 2024-04-12 09:35:47,120 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4674
+ 2024-04-12 09:35:47,391 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4675
+ 2024-04-12 09:35:47,392 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4676
+ 2024-04-12 09:35:48,431 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4677
+ 2024-04-12 09:35:53,432 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4678
+ 2024-04-12 09:35:56,647 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4679
+ 2024-04-12 09:35:56,648 DEBUG SenderThread:485 [sender.py:send():379] send: history
4680
+ 2024-04-12 09:35:56,648 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4681
+ 2024-04-12 09:35:56,648 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4682
+ 2024-04-12 09:35:56,794 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4683
+ 2024-04-12 09:35:59,398 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4684
+ 2024-04-12 09:35:59,795 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4685
+ 2024-04-12 09:36:02,121 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4686
+ 2024-04-12 09:36:02,391 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4687
+ 2024-04-12 09:36:02,392 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4688
+ 2024-04-12 09:36:04,429 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4689
+ 2024-04-12 09:36:09,430 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4690
+ 2024-04-12 09:36:14,431 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4691
+ 2024-04-12 09:36:15,267 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4692
+ 2024-04-12 09:36:17,121 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4693
+ 2024-04-12 09:36:17,391 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4694
+ 2024-04-12 09:36:17,392 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4695
+ 2024-04-12 09:36:19,475 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4696
+ 2024-04-12 09:36:21,983 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4697
+ 2024-04-12 09:36:21,984 DEBUG SenderThread:485 [sender.py:send():379] send: history
4698
+ 2024-04-12 09:36:21,984 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4699
+ 2024-04-12 09:36:21,986 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4700
+ 2024-04-12 09:36:22,804 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4701
+ 2024-04-12 09:36:23,804 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4702
+ 2024-04-12 09:36:24,717 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4703
+ 2024-04-12 09:36:29,718 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4704
+ 2024-04-12 09:36:32,121 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4705
+ 2024-04-12 09:36:32,391 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4706
+ 2024-04-12 09:36:32,392 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4707
+ 2024-04-12 09:36:35,434 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4708
+ 2024-04-12 09:36:40,435 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4709
+ 2024-04-12 09:36:45,268 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4710
+ 2024-04-12 09:36:46,269 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4711
+ 2024-04-12 09:36:46,955 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4712
+ 2024-04-12 09:36:46,956 DEBUG SenderThread:485 [sender.py:send():379] send: history
4713
+ 2024-04-12 09:36:46,956 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4714
+ 2024-04-12 09:36:46,957 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4715
+ 2024-04-12 09:36:47,398 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4716
+ 2024-04-12 09:36:47,409 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4717
+ 2024-04-12 09:36:47,409 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4718
+ 2024-04-12 09:36:47,813 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
wandb/run-20240412_074044-widovcn3/files/output.log CHANGED
@@ -558,4 +558,10 @@
558
  warnings.warn(
559
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
560
  warnings.warn(
 
 
 
 
 
 
561
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
 
558
  warnings.warn(
559
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
560
  warnings.warn(
561
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
562
+ warnings.warn(
563
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
564
+ warnings.warn(
565
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
566
+ warnings.warn(
567
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
wandb/run-20240412_074044-widovcn3/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 3.5598, "train/grad_norm": 34.580299377441406, "train/learning_rate": 2.5310626050032873e-05, "train/epoch": 0.45, "train/global_step": 5620, "_timestamp": 1712914531.3273478, "_runtime": 6886.819629669189, "_step": 280}
 
1
+ {"train/loss": 3.4724, "train/grad_norm": 29.19519805908203, "train/learning_rate": 2.5204286784964823e-05, "train/epoch": 0.45, "train/global_step": 5680, "_timestamp": 1712914606.9547548, "_runtime": 6962.447036743164, "_step": 283}
wandb/run-20240412_074044-widovcn3/logs/debug-internal.log CHANGED
@@ -4666,3 +4666,53 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
4666
  2024-04-12 09:35:32,391 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4667
  2024-04-12 09:35:32,392 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4668
  2024-04-12 09:35:32,530 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4666
  2024-04-12 09:35:32,391 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4667
  2024-04-12 09:35:32,392 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4668
  2024-04-12 09:35:32,530 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4669
+ 2024-04-12 09:35:33,785 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4670
+ 2024-04-12 09:35:37,531 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4671
+ 2024-04-12 09:35:42,532 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4672
+ 2024-04-12 09:35:45,270 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4673
+ 2024-04-12 09:35:47,120 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4674
+ 2024-04-12 09:35:47,391 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4675
+ 2024-04-12 09:35:47,392 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4676
+ 2024-04-12 09:35:48,431 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4677
+ 2024-04-12 09:35:53,432 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4678
+ 2024-04-12 09:35:56,647 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4679
+ 2024-04-12 09:35:56,648 DEBUG SenderThread:485 [sender.py:send():379] send: history
4680
+ 2024-04-12 09:35:56,648 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4681
+ 2024-04-12 09:35:56,648 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4682
+ 2024-04-12 09:35:56,794 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4683
+ 2024-04-12 09:35:59,398 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4684
+ 2024-04-12 09:35:59,795 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4685
+ 2024-04-12 09:36:02,121 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4686
+ 2024-04-12 09:36:02,391 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4687
+ 2024-04-12 09:36:02,392 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4688
+ 2024-04-12 09:36:04,429 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4689
+ 2024-04-12 09:36:09,430 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4690
+ 2024-04-12 09:36:14,431 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4691
+ 2024-04-12 09:36:15,267 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4692
+ 2024-04-12 09:36:17,121 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4693
+ 2024-04-12 09:36:17,391 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4694
+ 2024-04-12 09:36:17,392 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4695
+ 2024-04-12 09:36:19,475 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4696
+ 2024-04-12 09:36:21,983 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4697
+ 2024-04-12 09:36:21,984 DEBUG SenderThread:485 [sender.py:send():379] send: history
4698
+ 2024-04-12 09:36:21,984 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4699
+ 2024-04-12 09:36:21,986 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4700
+ 2024-04-12 09:36:22,804 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4701
+ 2024-04-12 09:36:23,804 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4702
+ 2024-04-12 09:36:24,717 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4703
+ 2024-04-12 09:36:29,718 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4704
+ 2024-04-12 09:36:32,121 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4705
+ 2024-04-12 09:36:32,391 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4706
+ 2024-04-12 09:36:32,392 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4707
+ 2024-04-12 09:36:35,434 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4708
+ 2024-04-12 09:36:40,435 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4709
+ 2024-04-12 09:36:45,268 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4710
+ 2024-04-12 09:36:46,269 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4711
+ 2024-04-12 09:36:46,955 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4712
+ 2024-04-12 09:36:46,956 DEBUG SenderThread:485 [sender.py:send():379] send: history
4713
+ 2024-04-12 09:36:46,956 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4714
+ 2024-04-12 09:36:46,957 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4715
+ 2024-04-12 09:36:47,398 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4716
+ 2024-04-12 09:36:47,409 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4717
+ 2024-04-12 09:36:47,409 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4718
+ 2024-04-12 09:36:47,813 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb CHANGED
Binary files a/wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb and b/wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb differ