Model: rasyosef/phi-1_5-dpo
Author: rasyosef
Library: peft
Tags: peft, tensorboard, safetensors, trl, dpo, generated_from_trainer, dataset:HuggingFaceH4/ultrafeedback_binarized, dataset:argilla/distilabel-intel-orca-dpo-pairs, dataset:jondurbin/py-dpo-v0.1, dataset:argilla/distilabel-math-preference-dpo, base_model:rasyosef/phi-1_5-sft, base_model:adapter:rasyosef/phi-1_5-sft, license:mit, region:us
Base models (adapter): id: rasyosef/phi-1_5-sft
Card metadata: base_model: rasyosef/phi-1_5-sft
library_name: peft
license: mit
tags: trl, dpo, generated_from_trainer
model-index: name: phi-1_5-dpo
datasets: HuggingFaceH4/ultrafeedback_binarized, argilla/distilabel-intel-orca-dpo-pairs, jondurbin/py-dpo-v0.1, argilla/distilabel-math-preference-dpo
Likes: 0 | All-time downloads: 8
Created: 2024-07-22 22:24:00