Hugging Face model: zfz1/deepseek-8b-orpo-lora
Author: zfz1
Created: 2024-07-15 06:06:47
Last modified: 2024-07-18 09:42:18
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, tensorboard, safetensors, llama, alignment-handbook, trl, orpo, generated_from_trainer, dataset:zfz1/my_preference_gsm8k_deepseek, base_model:deepseek-ai/deepseek-math-7b-base, base_model:adapter:deepseek-ai/deepseek-math-7b-base, license:other, region:us
Base model relation: adapter
Base models: id: deepseek-ai/deepseek-math-7b-base
Card metadata:
base_model: deepseek-ai/deepseek-math-7b-base
datasets: zfz1/my_preference_gsm8k_deepseek
library_name: peft
license: other
tags: alignment-handbook, trl, orpo, generated_from_trainer