Model: nlee282/moai-dpo-1.0
Author: nlee282
Library: peft
Tags: peft, tensorboard, safetensors, trl, dpo, generated_from_trainer, dataset:unalignment/toxic-dpo-v0.1, base_model:unsloth/zephyr-sft-bnb-4bit, base_model:adapter:unsloth/zephyr-sft-bnb-4bit, region:us
Base models (adapter): id: unsloth/zephyr-sft-bnb-4bit
Card metadata: datasets: unalignment/toxic-dpo-v0.1
library_name: peft
tags: trl, dpo, generated_from_trainer
base_model: unsloth/zephyr-sft-bnb-4bit
model-index: name: outputs
Likes: 0 | All-time downloads: 62
Created: 2024-01-05 02:01:53