fietje-2 / checkpoint-2700 /global_step2700

1 contributor

History: 1 commit

BramVanroy

Training in progress, step 2700, checkpoint

fe2eeab verified 3 months ago

bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_10_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_11_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "collections.OrderedDict"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_12_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_13_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_14_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_15_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "collections.OrderedDict"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "collections.OrderedDict"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "collections.OrderedDict"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "collections.OrderedDict"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "collections.OrderedDict"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_6_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_7_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_8_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
bf16_zero_pp_rank_9_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
2.08 GB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_0_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_10_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_11_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_12_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_13_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_14_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_15_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_1_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_2_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_3_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_4_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_5_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_6_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_7_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_8_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago
zero_pp_rank_9_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
How to fix it?
215 kB
LFS

Training in progress, step 2700, checkpoint 3 months ago

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)