lewtun
/

gemma-7b-dpo-full-openhermes-mix1-beta-0.1

Text Generation

alignment-handbook

generated_from_trainer

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

gemma-7b-dpo-full-openhermes-mix1-beta-0.1 / eval_results.json

lewtun's picture

lewtun HF staff

End of training

6093ff4 verified 3 months ago

raw history blame contribute delete

No virus

564 Bytes

	{
	"epoch": 0.99,
	"eval_logits/chosen": 110.9354476928711,
	"eval_logits/rejected": 104.462890625,
	"eval_logps/chosen": -833.5565795898438,
	"eval_logps/rejected": -861.5226440429688,
	"eval_loss": 0.621110200881958,
	"eval_rewards/accuracies": 0.7291666865348816,
	"eval_rewards/chosen": -0.26271167397499084,
	"eval_rewards/margins": 2.0050528049468994,
	"eval_rewards/rejected": -2.2677645683288574,
	"eval_runtime": 51.7287,
	"eval_samples": 750,
	"eval_samples_per_second": 14.499,
	"eval_steps_per_second": 0.464
	}