wandb: Currently logged in as: laurence_r. Use `wandb login --relogin` to force relogin wandb: Tracking run with wandb version 0.16.3 wandb: Run data is saved locally in /home/ubuntu/torchtune-colorful-llama/baseline/wandb/run-20240218_170205-iu28me1d wandb: Run `wandb offline` to turn off syncing. wandb: Syncing run auspicious-lamp-5 wandb: ⭐️ View project at https://wandb.ai/laurence_r/colorful-llama wandb: 🚀 View run at https://wandb.ai/laurence_r/colorful-llama/runs/iu28me1d Setting manual seed to local seed 42. Local seed is seed + rank = 42 + 0 Model is initialized. FSDP and Activation Checkpointing are enabled. Compiling model using torch.compile. The first batch may take a few minutes while compilation occurs. Tokenizer is initialized from file. Optimizer is initialized. Loss is initialized. Downloading readme: 0%| | 0.00/11.6k [00:00