Hugging Face model: smohammadi/llama2-lora-aligned-cpo
Author: smohammadi
Created: 2024-07-20 12:57:52
Last modified: 2024-07-20 13:51:00
Library: peft
Likes: 0 | Downloads: 3
Tags: peft, safetensors, trl, cpo, generated_from_trainer, base_model:google/gemma-2b, base_model:adapter:google/gemma-2b, license:gemma, region:us
Base model relation: adapter
Base models: id: google/gemma-2b
Card metadata:
base_model: google/gemma-2b
library_name: peft
license: gemma
tags: trl, cpo, generated_from_trainer