Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
efromomr
/
llm-course-hw2-reward-model-v2
like
0
Text Classification
Transformers
Safetensors
HumanLLMs/Human-Like-DPO-Dataset
llama
Generated from Trainer
trl
reward-trainer
text-generation-inference
Inference Endpoints
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
llm-course-hw2-reward-model-v2
1 contributor
History:
2 commits
efromomr
End of training
5e2afae
verified
18 days ago
.gitattributes
Safe
1.52 kB
initial commit
18 days ago
README.md
1.72 kB
End of training
18 days ago
config.json
1.03 kB
End of training
18 days ago
merges.txt
Safe
466 kB
End of training
18 days ago
model.safetensors
538 MB
LFS
End of training
18 days ago
special_tokens_map.json
Safe
544 Bytes
End of training
18 days ago
tokenizer.json
Safe
3.52 MB
End of training
18 days ago
tokenizer_config.json
Safe
3.62 kB
End of training
18 days ago
training_args.bin
pickle
Detected Pickle imports (10)
"trl.trainer.reward_config.RewardConfig"
,
"transformers.trainer_utils.SchedulerType"
,
"transformers.trainer_utils.IntervalStrategy"
,
"transformers.trainer_utils.HubStrategy"
,
"accelerate.state.PartialState"
,
"torch.device"
,
"transformers.trainer_pt_utils.AcceleratorConfig"
,
"accelerate.utils.dataclasses.DistributedType"
,
"transformers.training_args.OptimizerNames"
,
"transformers.trainer_utils.SaveStrategy"
How to fix it?
5.43 kB
LFS
End of training
18 days ago
vocab.json
Safe
801 kB
End of training
18 days ago