relaxml

/

Llama-3.1-405B-Instruct-QTIP-2Bit-TP8

like 1

Follow

RelaxML 28

• "collections.OrderedDict",
• "torch.BFloat16Storage",
• "torch._utils._rebuild_parameter",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "collections.OrderedDict",
• "torch.BFloat16Storage",
• "torch._utils._rebuild_parameter",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "collections.OrderedDict",
• "torch.BFloat16Storage",
• "torch._utils._rebuild_parameter",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "collections.OrderedDict",
• "torch.BFloat16Storage",
• "torch._utils._rebuild_parameter",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "collections.OrderedDict",
• "torch.BFloat16Storage",
• "torch._utils._rebuild_parameter",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "collections.OrderedDict",
• "torch.BFloat16Storage",
• "torch._utils._rebuild_parameter",
• "torch._utils._rebuild_tensor_v2"

How to fix it?