bigscience

/

bloomz-optimizer-states

like 1

Follow

BigScience Workshop 821

• "collections.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage"

How to fix it?

• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict"

How to fix it?

• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "collections.OrderedDict",
• "torch.FloatStorage",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "collections.OrderedDict",
• "torch.FloatStorage",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict",
• "collections.OrderedDict"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage"

How to fix it?

• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "collections.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage"

How to fix it?

• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage"

How to fix it?

• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict",
• "collections.OrderedDict"

How to fix it?

• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage"

How to fix it?

• "collections.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict",
• "collections.OrderedDict"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2"

How to fix it?