Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
HuggingFaceH4
/
zephyr-orpo-141b-A35b-v0.1
like
259
Text Generation
Transformers
TensorBoard
Safetensors
argilla/distilabel-capybara-dpo-7k-binarized
mixtral
trl
orpo
Generated from Trainer
conversational
text-generation-inference
Inference Endpoints
arxiv:
2403.07691
arxiv:
2311.07911
License:
apache-2.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
15
Train
Deploy
Use this model
refs/pr/13
zephyr-orpo-141b-A35b-v0.1
/
all_results.json
lewtun
HF staff
Model save
cf74763
verified
5 months ago
raw
Copy download link
history
blame
No virus
192 Bytes
{
"epoch"
:
3.0
,
"train_loss"
:
0.812556631554107
,
"train_runtime"
:
4771.9621
,
"train_samples"
:
6932
,
"train_samples_per_second"
:
4.358
,
"train_steps_per_second"
:
0.136
}