llm-jp-13b-v1.0-mdsfmt / global_step96657

3 contributors

History: 106 commits

Taishi-N324

Upload layer_17-model_00-model_states.pt

f5d1eb0 about 1 year ago

layer_02-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_02-model_00-model_states.pt about 1 year ago
layer_05-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_05-model_00-model_states.pt about 1 year ago
layer_06-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_06-model_00-model_states.pt about 1 year ago
layer_09-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_09-model_00-model_states.pt about 1 year ago
layer_11-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_11-model_00-model_states.pt about 1 year ago
layer_12-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_12-model_00-model_states.pt about 1 year ago
layer_13-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_13-model_00-model_states.pt about 1 year ago
layer_15-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_15-model_00-model_states.pt about 1 year ago
layer_16-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_16-model_00-model_states.pt about 1 year ago
layer_17-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_17-model_00-model_states.pt about 1 year ago
layer_20-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_20-model_00-model_states.pt about 1 year ago
layer_21-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_21-model_00-model_states.pt about 1 year ago
layer_22-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_22-model_00-model_states.pt about 1 year ago
layer_23-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_23-model_00-model_states.pt about 1 year ago
layer_26-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_26-model_00-model_states.pt about 1 year ago
layer_27-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_27-model_00-model_states.pt about 1 year ago
layer_28-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_28-model_00-model_states.pt about 1 year ago
layer_30-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_30-model_00-model_states.pt about 1 year ago
layer_31-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_31-model_00-model_states.pt about 1 year ago
layer_36-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_36-model_00-model_states.pt about 1 year ago
layer_38-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_38-model_00-model_states.pt about 1 year ago
layer_39-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_39-model_00-model_states.pt about 1 year ago
layer_42-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
21.7 kB
LFS

Upload layer_42-model_00-model_states.pt about 1 year ago
mp_rank_00_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_00_model_states.pt about 1 year ago
mp_rank_01_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_01_model_states.pt about 1 year ago
mp_rank_04_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_04_model_states.pt about 1 year ago
mp_rank_05_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_05_model_states.pt about 1 year ago
mp_rank_07_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_07_model_states.pt about 1 year ago
zero_pp_rank_0_mp_rank_02_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_02_optim_states.pt about 1 year ago
zero_pp_rank_0_mp_rank_03_optim_states.pt
Detected Pickle imports (7)
- "torch.float16",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_03_optim_states.pt about 1 year ago
zero_pp_rank_0_mp_rank_05_optim_states.pt
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.float16",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_05_optim_states.pt about 1 year ago
zero_pp_rank_0_mp_rank_06_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_06_optim_states.pt about 1 year ago
zero_pp_rank_10_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.float16",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.FloatStorage"
How to fix it?
1.84 GB
LFS

Upload zero_pp_rank_10_mp_rank_00_optim_states.pt about 1 year ago
zero_pp_rank_10_mp_rank_01_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_10_mp_rank_01_optim_states.pt about 1 year ago
zero_pp_rank_10_mp_rank_03_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_10_mp_rank_03_optim_states.pt about 1 year ago
zero_pp_rank_10_mp_rank_04_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.float16",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_10_mp_rank_04_optim_states.pt about 1 year ago
zero_pp_rank_10_mp_rank_05_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_10_mp_rank_05_optim_states.pt about 1 year ago
zero_pp_rank_10_mp_rank_07_optim_states.pt
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.float16",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict"
How to fix it?
1.84 GB
LFS

Upload zero_pp_rank_10_mp_rank_07_optim_states.pt about 1 year ago
zero_pp_rank_11_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "torch.float16",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
1.84 GB
LFS

Upload zero_pp_rank_11_mp_rank_00_optim_states.pt about 1 year ago
zero_pp_rank_11_mp_rank_01_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage",
- "torch.float16"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_11_mp_rank_01_optim_states.pt about 1 year ago
zero_pp_rank_11_mp_rank_03_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch._utils._rebuild_tensor_v2",
- "torch.float16",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_11_mp_rank_03_optim_states.pt about 1 year ago
zero_pp_rank_11_mp_rank_04_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "collections.OrderedDict",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_11_mp_rank_04_optim_states.pt about 1 year ago
zero_pp_rank_11_mp_rank_05_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.float16"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_11_mp_rank_05_optim_states.pt about 1 year ago
zero_pp_rank_11_mp_rank_06_optim_states.pt
Detected Pickle imports (7)
- "torch.float16",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_11_mp_rank_06_optim_states.pt about 1 year ago
zero_pp_rank_11_mp_rank_07_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch.float16",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
1.84 GB
LFS

Upload zero_pp_rank_11_mp_rank_07_optim_states.pt about 1 year ago
zero_pp_rank_1_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
1.84 GB
LFS

Upload zero_pp_rank_1_mp_rank_00_optim_states.pt about 1 year ago
zero_pp_rank_1_mp_rank_03_optim_states.pt
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.float16",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_1_mp_rank_03_optim_states.pt about 1 year ago
zero_pp_rank_1_mp_rank_06_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.float16",
- "torch.FloatStorage"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_1_mp_rank_06_optim_states.pt about 1 year ago
zero_pp_rank_1_mp_rank_07_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.float16"
How to fix it?
1.84 GB
LFS

Upload zero_pp_rank_1_mp_rank_07_optim_states.pt about 1 year ago
zero_pp_rank_2_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage"
How to fix it?
1.84 GB
LFS

Upload zero_pp_rank_2_mp_rank_00_optim_states.pt about 1 year ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)