Model: zfz1/deepseek-8b-orpo-lora
Author: zfz1
Library: peft
Tags: peft, tensorboard, safetensors, llama, alignment-handbook, trl, orpo, generated_from_trainer, dataset:zfz1/my_preference_gsm8k_deepseek, base_model:deepseek-ai/deepseek-math-7b-base, base_model:adapter:deepseek-ai/deepseek-math-7b-base, license:other, region:us
Base models (adapter): id: deepseek-ai/deepseek-math-7b-base
Card metadata: base_model: deepseek-ai/deepseek-math-7b-base
datasets: zfz1/my_preference_gsm8k_deepseek
library_name: peft
license: other
tags: alignment-handbook, trl, orpo, generated_from_trainer
model-index: name: deepseek-8b-orpo-lora
Likes: 0 | All-time downloads: 73
Created: 2024-07-15 06:06:47