diff --git "a/training_log_2024.02.18_17.17.08.log" "b/training_log_2024.02.18_17.17.08.log" new file mode 100644--- /dev/null +++ "b/training_log_2024.02.18_17.17.08.log" @@ -0,0 +1,67 @@ +wandb: Currently logged in as: laurence_r. Use `wandb login --relogin` to force relogin +wandb: Tracking run with wandb version 0.16.3 +wandb: Run data is saved locally in /home/ubuntu/torchtune-colorful-llama/colorful/wandb/run-20240218_171717-bm22a3e4 +wandb: Run `wandb offline` to turn off syncing. +wandb: Syncing run lambent-monkey-9 +wandb: ⭐️ View project at https://wandb.ai/laurence_r/colorful-llama +wandb: 🚀 View run at https://wandb.ai/laurence_r/colorful-llama/runs/bm22a3e4 +Setting manual seed to local seed 42. Local seed is seed + rank = 42 + 0 +Model is initialized. FSDP and Activation Checkpointing are enabled. +Compiling model using torch.compile. The first batch may take a few minutes while compilation occurs. +Tokenizer is initialized from file. +Optimizer is initialized. +Loss is initialized. + Downloading data files: 0%| | 0/1 [00:00