llm-jp-13b-v1.0-mdsfmt / global_step96657

3 contributors

History: 112 commits

Taishi-N324

Upload zero_pp_rank_2_mp_rank_03_optim_states.pt

867852b 11 months ago

layer_01-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
540 MB
LFS

Upload layer_01-model_00-model_states.pt 11 months ago
layer_02-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_02-model_00-model_states.pt 11 months ago
layer_05-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_05-model_00-model_states.pt 11 months ago
layer_06-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_06-model_00-model_states.pt 11 months ago
layer_09-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_09-model_00-model_states.pt 11 months ago
layer_11-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_11-model_00-model_states.pt 11 months ago
layer_12-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_12-model_00-model_states.pt 11 months ago
layer_13-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_13-model_00-model_states.pt 11 months ago
layer_15-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_15-model_00-model_states.pt 11 months ago
layer_16-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_16-model_00-model_states.pt 11 months ago
layer_17-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_17-model_00-model_states.pt 11 months ago
layer_20-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_20-model_00-model_states.pt 11 months ago
layer_21-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_21-model_00-model_states.pt 11 months ago
layer_22-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_22-model_00-model_states.pt 11 months ago
layer_23-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_23-model_00-model_states.pt 11 months ago
layer_26-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_26-model_00-model_states.pt 11 months ago
layer_27-model_00-model_states.pt
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_27-model_00-model_states.pt 11 months ago
layer_28-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_28-model_00-model_states.pt 11 months ago
layer_30-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_30-model_00-model_states.pt 11 months ago
layer_31-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_31-model_00-model_states.pt 11 months ago
layer_36-model_00-model_states.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
629 MB
LFS

Upload layer_36-model_00-model_states.pt 11 months ago
layer_38-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_38-model_00-model_states.pt 11 months ago
layer_39-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
629 MB
LFS

Upload layer_39-model_00-model_states.pt 11 months ago
layer_41-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
629 MB
LFS

Upload layer_41-model_00-model_states.pt 11 months ago
layer_42-model_00-model_states.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
21.7 kB
LFS

Upload layer_42-model_00-model_states.pt 11 months ago
mp_rank_00_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_00_model_states.pt 11 months ago
mp_rank_01_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_01_model_states.pt 11 months ago
mp_rank_02_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_02_model_states.pt 11 months ago
mp_rank_04_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_04_model_states.pt 11 months ago
mp_rank_05_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_05_model_states.pt 11 months ago
mp_rank_07_model_states.pt
Detected Pickle imports (13)
- "megatron.core.enums.ModelType",
- "numpy.ndarray",
- "argparse.Namespace",
- "collections.OrderedDict",
- "torch.float16",
- "torch.Size",
- "__builtin__.set",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.BoolStorage",
- "numpy.core.multiarray._reconstruct"
How to fix it?
4.23 MB
LFS

Upload mp_rank_07_model_states.pt 11 months ago
zero_pp_rank_0_mp_rank_02_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_02_optim_states.pt 11 months ago
zero_pp_rank_0_mp_rank_03_optim_states.pt
Detected Pickle imports (7)
- "torch.float16",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_03_optim_states.pt 11 months ago
zero_pp_rank_0_mp_rank_04_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_04_optim_states.pt 11 months ago
zero_pp_rank_0_mp_rank_05_optim_states.pt
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.float16",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_05_optim_states.pt 11 months ago
zero_pp_rank_0_mp_rank_06_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_0_mp_rank_06_optim_states.pt 11 months ago
zero_pp_rank_10_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.float16",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.FloatStorage"
How to fix it?
1.84 GB
LFS

Upload zero_pp_rank_10_mp_rank_00_optim_states.pt 11 months ago
zero_pp_rank_10_mp_rank_01_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_10_mp_rank_01_optim_states.pt 11 months ago
zero_pp_rank_10_mp_rank_03_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_10_mp_rank_03_optim_states.pt 11 months ago
zero_pp_rank_10_mp_rank_04_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.float16",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_10_mp_rank_04_optim_states.pt 11 months ago
zero_pp_rank_10_mp_rank_05_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_10_mp_rank_05_optim_states.pt 11 months ago
zero_pp_rank_10_mp_rank_07_optim_states.pt
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.float16",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict"
How to fix it?
1.84 GB
LFS

Upload zero_pp_rank_10_mp_rank_07_optim_states.pt 11 months ago
zero_pp_rank_11_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "torch.float16",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
1.84 GB
LFS

Upload zero_pp_rank_11_mp_rank_00_optim_states.pt 11 months ago
zero_pp_rank_11_mp_rank_01_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage",
- "torch.float16"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_11_mp_rank_01_optim_states.pt 11 months ago
zero_pp_rank_11_mp_rank_03_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch._utils._rebuild_tensor_v2",
- "torch.float16",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_11_mp_rank_03_optim_states.pt 11 months ago
zero_pp_rank_11_mp_rank_04_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "collections.OrderedDict",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_11_mp_rank_04_optim_states.pt 11 months ago
zero_pp_rank_11_mp_rank_05_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.float16"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_11_mp_rank_05_optim_states.pt 11 months ago
zero_pp_rank_11_mp_rank_06_optim_states.pt
Detected Pickle imports (7)
- "torch.float16",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
1.57 GB
LFS

Upload zero_pp_rank_11_mp_rank_06_optim_states.pt 11 months ago
zero_pp_rank_11_mp_rank_07_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch.float16",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
1.84 GB
LFS

Upload zero_pp_rank_11_mp_rank_07_optim_states.pt 11 months ago
zero_pp_rank_1_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.DynamicLossScaler",
- "torch.float16",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
1.84 GB
LFS

Upload zero_pp_rank_1_mp_rank_00_optim_states.pt 11 months ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (13)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)

Detected Pickle imports (7)