wandb: Currently logged in as: laurence_r. Use `wandb login --relogin` to force relogin wandb: Tracking run with wandb version 0.16.3 wandb: Run data is saved locally in /home/ubuntu/torchtune-colorful-llama/colorful/wandb/run-20240218_171649-qsv24pfw wandb: Run `wandb offline` to turn off syncing. wandb: Syncing run lucky-envelope-8 wandb: ⭐️ View project at https://wandb.ai/laurence_r/colorful-llama wandb: 🚀 View run at https://wandb.ai/laurence_r/colorful-llama/runs/qsv24pfw Setting manual seed to local seed 42. Local seed is seed + rank = 42 + 0 Model is initialized. FSDP and Activation Checkpointing are enabled. Compiling model using torch.compile. The first batch may take a few minutes while compilation occurs. Tokenizer is initialized from file. Optimizer is initialized. Loss is initialized. Dataset and Sampler are initialized. 0%| | 0/6470 [00:00