Hugging Face model: sfulay/kto-aligned-model-lora
Author: sfulay
Created: 2024-06-17 17:29:35
Last modified: 2024-06-17 17:31:03
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, safetensors, trl, kto, generated_from_trainer, base_model:trl-lib/qwen1.5-1.8b-sft, base_model:adapter:trl-lib/qwen1.5-1.8b-sft, license:other, region:us
Base model relation: adapter
Base models: id: trl-lib/qwen1.5-1.8b-sft
Card metadata:
base_model: trl-lib/qwen1.5-1.8b-sft
library_name: peft
license: other
tags: trl, kto, generated_from_trainer