Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
berkeley-nest
/
Starling-RM-7B-alpha
like
102
Follow
Berkeley-Nest
71
Transformers
PyTorch
berkeley-nest/Nectar
English
llama
reward model
RLHF
RLAIF
text-generation-inference
arxiv:
2203.02155
arxiv:
2301.11270
License:
apache-2.0
Model card
Files
Files and versions
Community
8
Train
Deploy
Use this model
1a1d0e4
Starling-RM-7B-alpha
Ctrl+K
Ctrl+K
5 contributors
History:
14 commits
banghua
davide221
Missing import for inference (
#5
)
1a1d0e4
verified
over 1 year ago
.gitattributes
Safe
1.52 kB
Duplicate from banghua/n_rm
over 1 year ago
README.md
6.67 kB
Missing import for inference (#5)
over 1 year ago
latest
Safe
15 Bytes
Duplicate from banghua/n_rm
over 1 year ago
pytorch_model.bin
Safe
pickle
Detected Pickle imports (3)
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.BFloat16Storage"
What is a pickle import?
26.7 GB
LFS
Duplicate from banghua/n_rm
over 1 year ago
rng_state_0.pth
pickle
Detected Pickle imports (7)
"numpy.dtype"
,
"torch.ByteStorage"
,
"numpy.ndarray"
,
"numpy.core.multiarray._reconstruct"
,
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"_codecs.encode"
How to fix it?
21.7 kB
LFS
Duplicate from banghua/n_rm
over 1 year ago
rng_state_1.pth
pickle
Detected Pickle imports (7)
"numpy.dtype"
,
"torch.ByteStorage"
,
"numpy.ndarray"
,
"numpy.core.multiarray._reconstruct"
,
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"_codecs.encode"
How to fix it?
21.7 kB
LFS
Duplicate from banghua/n_rm
over 1 year ago
rng_state_2.pth
pickle
Detected Pickle imports (7)
"numpy.dtype"
,
"torch.ByteStorage"
,
"numpy.ndarray"
,
"numpy.core.multiarray._reconstruct"
,
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"_codecs.encode"
How to fix it?
21.7 kB
LFS
Duplicate from banghua/n_rm
over 1 year ago
rng_state_3.pth
pickle
Detected Pickle imports (7)
"numpy.dtype"
,
"torch.ByteStorage"
,
"numpy.ndarray"
,
"numpy.core.multiarray._reconstruct"
,
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"_codecs.encode"
How to fix it?
21.7 kB
LFS
Duplicate from banghua/n_rm
over 1 year ago
rng_state_4.pth
pickle
Detected Pickle imports (7)
"numpy.dtype"
,
"torch.ByteStorage"
,
"numpy.ndarray"
,
"numpy.core.multiarray._reconstruct"
,
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"_codecs.encode"
How to fix it?
21.7 kB
LFS
Duplicate from banghua/n_rm
over 1 year ago
rng_state_5.pth
pickle
Detected Pickle imports (7)
"numpy.dtype"
,
"torch.ByteStorage"
,
"numpy.ndarray"
,
"numpy.core.multiarray._reconstruct"
,
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"_codecs.encode"
How to fix it?
21.7 kB
LFS
Duplicate from banghua/n_rm
over 1 year ago
rng_state_6.pth
pickle
Detected Pickle imports (7)
"numpy.dtype"
,
"torch.ByteStorage"
,
"numpy.ndarray"
,
"numpy.core.multiarray._reconstruct"
,
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"_codecs.encode"
How to fix it?
21.7 kB
LFS
Duplicate from banghua/n_rm
over 1 year ago
rng_state_7.pth
pickle
Detected Pickle imports (7)
"numpy.dtype"
,
"torch.ByteStorage"
,
"numpy.ndarray"
,
"numpy.core.multiarray._reconstruct"
,
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"_codecs.encode"
How to fix it?
21.7 kB
LFS
Duplicate from banghua/n_rm
over 1 year ago
trainer_state.json
Safe
18.9 kB
Duplicate from banghua/n_rm
over 1 year ago
training_args.bin
pickle
Detected Pickle imports (11)
"transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig"
,
"transformers.trainer_utils.HubStrategy"
,
"torch.device"
,
"torch.bfloat16"
,
"transformers.training_args.TrainingArguments"
,
"accelerate.utils.dataclasses.DistributedType"
,
"transformers.trainer_utils.IntervalStrategy"
,
"transformers.trainer_utils.SchedulerType"
,
"accelerate.utils.dataclasses.DeepSpeedPlugin"
,
"transformers.training_args.OptimizerNames"
,
"accelerate.state.PartialState"
How to fix it?
5.31 kB
LFS
Duplicate from banghua/n_rm
over 1 year ago
zero_to_fp32.py
Safe
24.2 kB
Duplicate from banghua/n_rm
over 1 year ago
