Hugging Face model: lewtun/kto-aligned-model-lora
Author: lewtun
Created: 2024-03-27 08:24:39
Last modified: 2024-03-27 08:24:41
Library: peft
Likes: 0 | Downloads: 3
Tags: peft, safetensors, trl, kto, generated_from_trainer, base_model:trl-lib/qwen1.5-1.8b-sft, base_model:adapter:trl-lib/qwen1.5-1.8b-sft, license:other, region:us
Base model relation: adapter
Base models: id: trl-lib/qwen1.5-1.8b-sft
Card metadata:
license: other
library_name: peft
tags: trl, kto, generated_from_trainer
base_model: trl-lib/qwen1.5-1.8b-sft