Model: sfulay/kto-aligned-model-lora
Author: sfulay
Library: peft
Tags: peft, safetensors, trl, kto, generated_from_trainer, base_model:trl-lib/qwen1.5-1.8b-sft, base_model:adapter:trl-lib/qwen1.5-1.8b-sft, license:other, region:us
Base models (adapter): id: trl-lib/qwen1.5-1.8b-sft
Card metadata: base_model: trl-lib/qwen1.5-1.8b-sft
library_name: peft
license: other
tags: trl, kto, generated_from_trainer
model-index: name: kto-aligned-model-lora
Likes: 0 | All-time downloads: 41
Created: 2024-06-17 17:29:35