Hugging Face model: mradermacher/stablelm-2-1_6b-orpo-full-v3-GGUF
Author: mradermacher
Created: 2025-01-05 02:41:30
Last modified: 2025-01-05 02:49:52
Library: transformers
Likes: 0 | Downloads: 54
Tags: transformers, gguf, alignment-handbook, trl, orpo, generated_from_trainer, en, dataset:argilla/ultrafeedback-binarized-preferences-cleaned, dataset:argilla/distilabel-capybara-dpo-7k-binarized, license:other, endpoints_compatible, region:us, conversational
Card metadata:
base_model: vain05/stablelm-2-1_6b-orpo-full-v3
datasets: argilla/ultrafeedback-binarized-preferences-cleaned, argilla/distilabel-capybara-dpo-7k-binarized
language: en
library_name: transformers
license: other
quantized_by: mradermacher
tags: alignment-handbook, trl, orpo, generated_from_trainer, trl, orpo, generated_from_trainer