lm1-83m-20b-nowarmup / global_step37905

1 contributor

History: 1 commit

Muennighoff

Add ckpt, logs

bbbe530 over 1 year ago

bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_100_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_101_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_102_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_103_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_104_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_105_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_106_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_107_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_108_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_109_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_10_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_110_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_111_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_112_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_113_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_114_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_115_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_116_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_117_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_118_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_119_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_11_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_120_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_121_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_122_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_123_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_124_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_125_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_126_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_127_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_128_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_129_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_12_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_130_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_131_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_132_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_133_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_134_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_135_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_136_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_137_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_138_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_139_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_13_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_140_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_141_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_142_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_143_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago
bf16_zero_pp_rank_144_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
3.88 MB
LFS

Add ckpt, logs over 1 year ago

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)