diff --git "a/training_log_2024.02.18_17.16.40.log" "b/training_log_2024.02.18_17.16.40.log" new file mode 100644--- /dev/null +++ "b/training_log_2024.02.18_17.16.40.log" @@ -0,0 +1,42 @@ +wandb: Currently logged in as: laurence_r. Use `wandb login --relogin` to force relogin +wandb: Tracking run with wandb version 0.16.3 +wandb: Run data is saved locally in /home/ubuntu/torchtune-colorful-llama/colorful/wandb/run-20240218_171649-qsv24pfw +wandb: Run `wandb offline` to turn off syncing. +wandb: Syncing run lucky-envelope-8 +wandb: ⭐️ View project at https://wandb.ai/laurence_r/colorful-llama +wandb: 🚀 View run at https://wandb.ai/laurence_r/colorful-llama/runs/qsv24pfw +Setting manual seed to local seed 42. Local seed is seed + rank = 42 + 0 +Model is initialized. FSDP and Activation Checkpointing are enabled. +Compiling model using torch.compile. The first batch may take a few minutes while compilation occurs. +Tokenizer is initialized from file. +Optimizer is initialized. +Loss is initialized. +Dataset and Sampler are initialized. + 0%| | 0/6470 [00:00