llm-jp-13b-v1.0-mdsfmt / global_step96657

3 contributors

History: 138 commits

Taishi-N324

Upload layer_33-model_00-model_states.pt

430923b 12 months ago

layer_01-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
540 MB
LFS

Upload layer_01-model_00-model_states.pt 12 months ago
layer_02-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_02-model_00-model_states.pt 12 months ago
layer_03-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_03-model_00-model_states.pt 12 months ago
layer_05-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_05-model_00-model_states.pt 12 months ago
layer_06-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_06-model_00-model_states.pt 12 months ago
layer_07-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_07-model_00-model_states.pt 12 months ago
layer_08-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_08-model_00-model_states.pt 12 months ago
layer_09-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_09-model_00-model_states.pt 12 months ago
layer_10-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_10-model_00-model_states.pt 12 months ago
layer_11-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_11-model_00-model_states.pt 12 months ago
layer_12-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_12-model_00-model_states.pt 12 months ago
layer_13-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_13-model_00-model_states.pt 12 months ago
layer_14-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_14-model_00-model_states.pt 12 months ago
layer_15-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_15-model_00-model_states.pt 12 months ago
layer_16-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_16-model_00-model_states.pt 12 months ago
layer_17-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_17-model_00-model_states.pt 12 months ago
layer_18-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_18-model_00-model_states.pt 12 months ago
layer_19-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_19-model_00-model_states.pt 12 months ago
layer_20-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_20-model_00-model_states.pt 12 months ago
layer_21-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_21-model_00-model_states.pt 12 months ago
layer_22-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_22-model_00-model_states.pt 12 months ago
layer_23-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_23-model_00-model_states.pt 12 months ago
layer_24-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_24-model_00-model_states.pt 12 months ago
layer_25-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_25-model_00-model_states.pt 12 months ago
layer_26-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_26-model_00-model_states.pt 12 months ago
layer_27-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_27-model_00-model_states.pt 12 months ago
layer_28-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_28-model_00-model_states.pt 12 months ago
layer_30-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_30-model_00-model_states.pt 12 months ago
layer_31-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_31-model_00-model_states.pt 12 months ago
layer_32-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_32-model_00-model_states.pt 12 months ago
layer_33-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_33-model_00-model_states.pt 12 months ago
layer_34-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_34-model_00-model_states.pt 12 months ago
layer_35-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_35-model_00-model_states.pt 12 months ago
layer_36-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_36-model_00-model_states.pt 12 months ago
layer_38-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_38-model_00-model_states.pt 12 months ago
layer_39-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_39-model_00-model_states.pt 12 months ago
layer_41-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_41-model_00-model_states.pt 12 months ago
layer_42-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
21.7 kB
LFS

Upload layer_42-model_00-model_states.pt 12 months ago
mp_rank_00_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_00_model_states.pt 12 months ago
mp_rank_01_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_01_model_states.pt 12 months ago
mp_rank_02_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_02_model_states.pt 12 months ago
mp_rank_03_model_states.pt
Detected Pickle imports (13)
- "torch.float16",
- "numpy.ndarray",
- "_codecs.encode",
- "numpy.dtype",
- "__builtin__.set",
- "torch.BoolStorage",
- "collections.OrderedDict",
- "numpy.core.multiarray._reconstruct",
- "torch.Size",
- "megatron.core.enums.ModelType",
- "torch._utils._rebuild_tensor_v2",
- "argparse.Namespace",
- "torch.ByteStorage"
How to fix it?
4.23 MB
LFS

Upload mp_rank_03_model_states.pt 12 months ago
mp_rank_04_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_04_model_states.pt 12 months ago
mp_rank_05_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_05_model_states.pt 12 months ago
mp_rank_06_model_states.pt
Detected Pickle imports (13)
- "torch.float16",
- "torch.BoolStorage",
- "numpy.ndarray",
- "numpy.dtype",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "torch.Size",
- "torch._utils._rebuild_tensor_v2",
- "_codecs.encode",
- "numpy.core.multiarray._reconstruct",
- "__builtin__.set",
- "argparse.Namespace",
- "megatron.core.enums.ModelType"
How to fix it?
4.23 MB
LFS

Upload mp_rank_06_model_states.pt 12 months ago
mp_rank_07_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_07_model_states.pt 12 months ago
zero_pp_rank_0_mp_rank_01_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch.float16",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_01_optim_states.pt 12 months ago
zero_pp_rank_0_mp_rank_02_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_02_optim_states.pt 12 months ago
zero_pp_rank_0_mp_rank_03_optim_states.pt
Detected Pickle imports (7)
- "torch.float16",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_03_optim_states.pt 12 months ago
zero_pp_rank_0_mp_rank_04_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_04_optim_states.pt 12 months ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)