llm-jp-13b-v1.0-mdsfmt / global_step96657

3 contributors

History: 133 commits

Taishi-N324

Upload layer_34-model_00-model_states.pt

6da1093 about 1 year ago

layer_01-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
540 MB
LFS

Upload layer_01-model_00-model_states.pt about 1 year ago
layer_02-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_02-model_00-model_states.pt about 1 year ago
layer_03-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_03-model_00-model_states.pt about 1 year ago
layer_05-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_05-model_00-model_states.pt about 1 year ago
layer_06-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_06-model_00-model_states.pt about 1 year ago
layer_08-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_08-model_00-model_states.pt about 1 year ago
layer_09-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_09-model_00-model_states.pt about 1 year ago
layer_10-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_10-model_00-model_states.pt about 1 year ago
layer_11-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_11-model_00-model_states.pt about 1 year ago
layer_12-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_12-model_00-model_states.pt about 1 year ago
layer_13-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_13-model_00-model_states.pt about 1 year ago
layer_15-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_15-model_00-model_states.pt about 1 year ago
layer_16-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_16-model_00-model_states.pt about 1 year ago
layer_17-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_17-model_00-model_states.pt about 1 year ago
layer_18-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_18-model_00-model_states.pt about 1 year ago
layer_19-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_19-model_00-model_states.pt about 1 year ago
layer_20-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_20-model_00-model_states.pt about 1 year ago
layer_21-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_21-model_00-model_states.pt about 1 year ago
layer_22-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_22-model_00-model_states.pt about 1 year ago
layer_23-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_23-model_00-model_states.pt about 1 year ago
layer_24-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_24-model_00-model_states.pt about 1 year ago
layer_25-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_25-model_00-model_states.pt about 1 year ago
layer_26-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_26-model_00-model_states.pt about 1 year ago
layer_27-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_27-model_00-model_states.pt about 1 year ago
layer_28-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_28-model_00-model_states.pt about 1 year ago
layer_30-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_30-model_00-model_states.pt about 1 year ago
layer_31-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_31-model_00-model_states.pt about 1 year ago
layer_32-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_32-model_00-model_states.pt about 1 year ago
layer_34-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_34-model_00-model_states.pt about 1 year ago
layer_35-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_35-model_00-model_states.pt about 1 year ago
layer_36-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_36-model_00-model_states.pt about 1 year ago
layer_38-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_38-model_00-model_states.pt about 1 year ago
layer_39-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_39-model_00-model_states.pt about 1 year ago
layer_41-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_41-model_00-model_states.pt about 1 year ago
layer_42-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
21.7 kB
LFS

Upload layer_42-model_00-model_states.pt about 1 year ago
mp_rank_00_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_00_model_states.pt about 1 year ago
mp_rank_01_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_01_model_states.pt about 1 year ago
mp_rank_02_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_02_model_states.pt about 1 year ago
mp_rank_03_model_states.pt
Detected Pickle imports (13)
- "torch.float16",
- "numpy.ndarray",
- "_codecs.encode",
- "numpy.dtype",
- "__builtin__.set",
- "torch.BoolStorage",
- "collections.OrderedDict",
- "numpy.core.multiarray._reconstruct",
- "torch.Size",
- "megatron.core.enums.ModelType",
- "torch._utils._rebuild_tensor_v2",
- "argparse.Namespace",
- "torch.ByteStorage"
How to fix it?
4.23 MB
LFS

Upload mp_rank_03_model_states.pt about 1 year ago
mp_rank_04_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_04_model_states.pt about 1 year ago
mp_rank_05_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_05_model_states.pt about 1 year ago
mp_rank_07_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_07_model_states.pt about 1 year ago
zero_pp_rank_0_mp_rank_01_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch.float16",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_01_optim_states.pt about 1 year ago
zero_pp_rank_0_mp_rank_02_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_02_optim_states.pt about 1 year ago
zero_pp_rank_0_mp_rank_03_optim_states.pt
Detected Pickle imports (7)
- "torch.float16",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_03_optim_states.pt about 1 year ago
zero_pp_rank_0_mp_rank_04_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_04_optim_states.pt about 1 year ago
zero_pp_rank_0_mp_rank_05_optim_states.pt
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.float16",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_05_optim_states.pt about 1 year ago
zero_pp_rank_0_mp_rank_06_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_06_optim_states.pt about 1 year ago
zero_pp_rank_10_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.float16",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.FloatStorage"
How to fix it?
1.84 GB
LFS

Upload zero_pp_rank_10_mp_rank_00_optim_states.pt about 1 year ago
zero_pp_rank_10_mp_rank_01_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_10_mp_rank_01_optim_states.pt about 1 year ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)