Hugging Face model: mradermacher/Kybalion-1B-DPO-GGUF
Author: mradermacher
Created: 2026-05-22 15:34:50
Last modified: 2026-05-22 15:43:10
Library: transformers
Likes: 0 | Downloads: 51
Tags: transformers, gguf, dpo, rlhf, llama, llama-3.2, kybalion, trl, peft, lora, merged, en, dataset:argilla/ultrafeedback-binarized-preferences-cleaned, base_model:devwoo/Kybalion-1B-DPO, base_model:adapter:devwoo/Kybalion-1B-DPO, license:llama3.2, endpoints_compatible, region:us, conversational
Base model relation: adapter
Base models: id: devwoo/Kybalion-1B-DPO
Card metadata:
base_model: devwoo/Kybalion-1B-DPO
datasets: argilla/ultrafeedback-binarized-preferences-cleaned
language: en
library_name: transformers
license: llama3.2
mradermacher: readme_rev: 1
quantized_by: mradermacher
tags: dpo, rlhf, llama, llama-3.2, kybalion, trl, peft, lora, merged