Model: vain05/stablelm-2-1_6b-orpo-full-v2
Author: vain05
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, stablelm, text-generation, alignment-handbook, trl, orpo, generated_from_trainer, conversational, dataset:argilla/ultrafeedback-binarized-preferences-cleaned, base_model:stabilityai/stablelm-2-1_6b, base_model:finetune:stabilityai/stablelm-2-1_6b, license:other, endpoints_compatible, region:us
Base models (finetune): id: stabilityai/stablelm-2-1_6b
Card metadata: license: other
base_model: stabilityai/stablelm-2-1_6b
tags: alignment-handbook, trl, orpo, generated_from_trainer, trl, orpo, generated_from_trainer
datasets: argilla/ultrafeedback-binarized-preferences-cleaned
model-index: name: stablelm-2-1_6b-orpo-full-v2
Likes: 0 | All-time downloads: 16
Created: 2024-04-06 12:54:45