llm-jp

/

llm-jp-13b-v1.0-mdsfmt

like 0

Follow

LLM-jp 169

• "torch.float16",
• "deepspeed.utils.tensor_fragment.fragment_address",
• "collections.OrderedDict",
• "deepspeed.runtime.zero.config.ZeroStageEnum",
• "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.float16",
• "deepspeed.runtime.zero.config.ZeroStageEnum",
• "torch.FloatStorage",
• "deepspeed.utils.tensor_fragment.fragment_address",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"

How to fix it?

• "deepspeed.utils.tensor_fragment.fragment_address",
• "deepspeed.runtime.zero.config.ZeroStageEnum",
• "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "torch.float16",
• "torch._utils._rebuild_tensor_v2"

How to fix it?