Accelerate documentation

Learning how to incorporate πŸ€— Accelerate features quickly!

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v0.28.0).
Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

Learning how to incorporate πŸ€— Accelerate features quickly!

Please use the interactive tool below to help you get started with learning about a particular feature of πŸ€— Accelerate and how to utilize it! It will provide you with a code diff, an explanation towards what is going on, as well as provide you with some useful links to explore more within the documentation!

Most code examples start from the following python code before integrating πŸ€— Accelerate in some way:

for batch in dataloader:
    optimizer.zero_grad()
    inputs, targets = batch
    inputs = inputs.to(device)
    targets = targets.to(device)
    outputs = model(inputs)
    loss = loss_function(outputs, targets)
    loss.backward()
    optimizer.step()
    scheduler.step()