Hugging Face model: yuansui/llama2_7b_instruct_sft_dpo
Author: yuansui
Created: 2024-08-25 12:08:17
Last modified: 2024-08-25 15:07:34
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 4
Tags: transformers, safetensors, llama, text-generation, alignment-handbook, trl, dpo, generated_from_trainer, conversational, dataset:xinlai/Math-Step-DPO-10K, text-generation-inference, endpoints_compatible, region:us
Card metadata:
library_name: transformers
base_model: llama-2-7b-instruct-sft
tags: alignment-handbook, trl, dpo, alignment-handbook, generated_from_trainer
datasets: xinlai/Math-Step-DPO-10K