Moves the optimizer.zero_grad to the end, solves this issue: https://github.com/huggingface/accelerate/issues/1422

muellerzr changed pull request status to open
muellerzr changed pull request status to merged

Sign up or log in to comment