Hugging Face model: rasyosef/phi-1_5-dpo
Author: rasyosef
Created: 2024-07-22 22:24:00
Last modified: 2024-07-31 21:27:40
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, tensorboard, safetensors, trl, dpo, generated_from_trainer, dataset:HuggingFaceH4/ultrafeedback_binarized, dataset:argilla/distilabel-intel-orca-dpo-pairs, dataset:jondurbin/py-dpo-v0.1, dataset:argilla/distilabel-math-preference-dpo, base_model:rasyosef/phi-1_5-sft, base_model:adapter:rasyosef/phi-1_5-sft, license:mit, region:us
Base model relation: adapter
Base models: id: rasyosef/phi-1_5-sft
Card metadata:
base_model: rasyosef/phi-1_5-sft
library_name: peft
license: mit
tags: trl, dpo, generated_from_trainer
datasets: HuggingFaceH4/ultrafeedback_binarized, argilla/distilabel-intel-orca-dpo-pairs, jondurbin/py-dpo-v0.1, argilla/distilabel-math-preference-dpo