The documentation page ACCELERATE/DEEPSPEED-ZERO3-OFFLOAD doesn’t exist in v0.13.0, but exists on the main version. Click here to redirect to the main version of the documentation.