Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
berkeley-nest
/
Starling-RM-7B-alpha
like
98
Transformers
PyTorch
berkeley-nest/Nectar
English
llama
reward model
RLHF
RLAIF
text-generation-inference
Inference Endpoints
arxiv:
2203.02155
arxiv:
2301.11270
License:
apache-2.0
Model card
Files
Files and versions
Community
7
Train
Deploy
Use this model
6f8f5dc
Starling-RM-7B-alpha
/
global_step1400
5 contributors
History:
1 commit
banghua
Duplicate from banghua/n_rm
6f8f5dc
10 months ago
bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"collections.OrderedDict"
,
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
How to fix it?
10.1 GB
LFS
Duplicate from banghua/n_rm
10 months ago
bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"torch.FloatStorage"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
10.1 GB
LFS
Duplicate from banghua/n_rm
10 months ago
bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"collections.OrderedDict"
,
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
10.1 GB
LFS
Duplicate from banghua/n_rm
10 months ago
bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"collections.OrderedDict"
,
"torch.FloatStorage"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"torch._utils._rebuild_tensor_v2"
,
"deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
10.1 GB
LFS
Duplicate from banghua/n_rm
10 months ago
bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"collections.OrderedDict"
,
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
10.1 GB
LFS
Duplicate from banghua/n_rm
10 months ago
bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"collections.OrderedDict"
,
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
10.1 GB
LFS
Duplicate from banghua/n_rm
10 months ago
bf16_zero_pp_rank_6_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"collections.OrderedDict"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
How to fix it?
10.1 GB
LFS
Duplicate from banghua/n_rm
10 months ago
bf16_zero_pp_rank_7_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"collections.OrderedDict"
,
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
10.1 GB
LFS
Duplicate from banghua/n_rm
10 months ago
mp_rank_00_model_states.pt
pickle
Detected Pickle imports (5)
"torch.BFloat16Storage"
,
"collections.OrderedDict"
,
"torch.Size"
,
"__builtin__.set"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
13.5 GB
LFS
Duplicate from banghua/n_rm
10 months ago
