2 contributors

History: 72 commits

hails

Upload zero_pp_rank_40_mp_rank_00_optim_states.pt

f255fe9 over 1 year ago

.gitattributes

1.48 kB

initial commit over 1 year ago
1B-deduped.yml

2.15 kB

Upload 1B-deduped.yml over 1 year ago
layer_00-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
206 MB
LFS

Upload layer_00-model_00-model_states.pt over 1 year ago
layer_02-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
101 MB
LFS

Upload layer_02-model_00-model_states.pt over 1 year ago
layer_03-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
101 MB
LFS

Upload layer_03-model_00-model_states.pt over 1 year ago
layer_04-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
101 MB
LFS

Upload layer_04-model_00-model_states.pt over 1 year ago
layer_05-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
101 MB
LFS

Upload layer_05-model_00-model_states.pt over 1 year ago
layer_06-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
101 MB
LFS

Upload layer_06-model_00-model_states.pt over 1 year ago
layer_07-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
101 MB
LFS

Upload layer_07-model_00-model_states.pt over 1 year ago
layer_10-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
101 MB
LFS

Upload layer_10-model_00-model_states.pt over 1 year ago
layer_11-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
101 MB
LFS

Upload layer_11-model_00-model_states.pt over 1 year ago
layer_12-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
101 MB
LFS

Upload layer_12-model_00-model_states.pt over 1 year ago
layer_13-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
101 MB
LFS

Upload layer_13-model_00-model_states.pt over 1 year ago
layer_14-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
101 MB
LFS

Upload layer_14-model_00-model_states.pt over 1 year ago
layer_15-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
101 MB
LFS

Upload layer_15-model_00-model_states.pt over 1 year ago
layer_16-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
101 MB
LFS

Upload layer_16-model_00-model_states.pt over 1 year ago
layer_17-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
101 MB
LFS

Upload layer_17-model_00-model_states.pt over 1 year ago
layer_19-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
9.41 kB
LFS

Upload layer_19-model_00-model_states.pt over 1 year ago
layer_20-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
206 MB
LFS

Upload layer_20-model_00-model_states.pt over 1 year ago
mp_rank_00_model_states.pt
Detected Pickle imports (8)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "numpy.ndarray",
- "_codecs.encode",
- "numpy.dtype",
- "__builtin__.set",
- "torch.ByteStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
16.6 kB
LFS

Upload mp_rank_00_model_states.pt over 1 year ago
zero_pp_rank_0_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_0_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_10_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_10_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_11_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_11_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_12_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_12_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_13_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_13_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_14_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_14_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_16_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_16_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_17_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_17_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_18_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_18_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_19_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_19_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_1_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_1_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_22_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage",
- "torch.Size"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_22_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_23_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage",
- "torch.Size"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_23_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_24_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.Size",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_24_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_25_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.Size",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_25_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_26_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.Size",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_26_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_27_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.Size",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_27_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_28_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.Size",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_28_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_2_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.Size",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_2_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_30_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.Size",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_30_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_31_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_31_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_32_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_32_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_33_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_33_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_36_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_36_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_37_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_37_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_38_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "torch.Size",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_38_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_39_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage",
- "torch.Size",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_39_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_40_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage",
- "torch.Size",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_40_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_42_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage",
- "torch.Size",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_42_mp_rank_00_optim_states.pt over 1 year ago
zero_pp_rank_43_mp_rank_00_optim_states.pt
Detected Pickle imports (5)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage",
- "torch.Size",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
191 MB
LFS

Upload zero_pp_rank_43_mp_rank_00_optim_states.pt over 1 year ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (8)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)

Detected Pickle imports (5)