Hugging Face model: devwoo/Kybalion-1B-DPO
Author: devwoo
Created: 2026-05-21 01:02:04
Last modified: 2026-05-21 19:36:41
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 5
Tags: transformers, safetensors, llama, text-generation, dpo, rlhf, llama-3.2, kybalion, trl, peft, lora, merged, conversational, en, dataset:argilla/ultrafeedback-binarized-preferences-cleaned, arxiv:2504.12501, arxiv:2310.16944, arxiv:2305.18290, arxiv:2203.02155, base_model:devwoo/Kybalion-1B, base_model:adapter:devwoo/Kybalion-1B, license:llama3.2, text-generation-inference, endpoints_compatible, region:us
Base model relation: adapter
Base models: id: devwoo/Kybalion-1B
Card metadata:
license: llama3.2
base_model: devwoo/Kybalion-1B
tags: dpo, rlhf, llama, llama-3.2, kybalion, trl, peft, lora, merged
datasets: argilla/ultrafeedback-binarized-preferences-cleaned
language: en
library_name: transformers
pipeline_tag: text-generation