datablations
/

lm1-8b7-176b-c4-ckpts

Model card Files Files and versions Community

lm1-8b7-176b-c4-ckpts / global_step65000

1 contributor

History: 1 commit

Muennighoff

Add

38921cb over 1 year ago

bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_0_mp_rank_01_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_0_mp_rank_02_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_0_mp_rank_03_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_100_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_100_mp_rank_01_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_100_mp_rank_02_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_100_mp_rank_03_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_101_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_101_mp_rank_01_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_101_mp_rank_02_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_101_mp_rank_03_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_102_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_102_mp_rank_01_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_102_mp_rank_02_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_102_mp_rank_03_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_103_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_103_mp_rank_01_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_103_mp_rank_02_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_103_mp_rank_03_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_104_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_104_mp_rank_01_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_104_mp_rank_02_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_104_mp_rank_03_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_105_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_105_mp_rank_01_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_105_mp_rank_02_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_105_mp_rank_03_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_106_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_106_mp_rank_01_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_106_mp_rank_02_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_106_mp_rank_03_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_107_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_107_mp_rank_01_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_107_mp_rank_02_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_107_mp_rank_03_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_108_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_108_mp_rank_01_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_108_mp_rank_02_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_108_mp_rank_03_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_109_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_109_mp_rank_01_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_109_mp_rank_02_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_109_mp_rank_03_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_10_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_10_mp_rank_01_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_10_mp_rank_02_optim_states.pt
Detected Pickle imports (4)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_10_mp_rank_03_optim_states.pt
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_110_mp_rank_00_optim_states.pt
Detected Pickle imports (4)
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
209 MB
LFS

Add over 1 year ago
bf16_zero_pp_rank_110_mp_rank_01_optim_states.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
209 MB
LFS

Add over 1 year ago

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)