Hugging Face model: demonlxrd/olmoe-openhermes-ultrafeedback-dora-dpo
Author: demonlxrd
Created: 2025-11-08 05:06:11
Last modified: 2025-11-08 06:07:27
Pipeline: text-generation
Library: peft
Likes: 1 | Downloads: 15
Tags: peft, safetensors, dpo, dora, qlora, lora, olmoe, alignment, preference-learning, transformers, trl, text-generation, conversational, en, dataset:teknium/OpenHermes-2.5, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:1024m/OLMoE-1B-7B-0924-Base, base_model:adapter:1024m/OLMoE-1B-7B-0924-Base, license:apache-2.0, region:us
Base model relation: adapter
Base models: id: 1024m/OLMoE-1B-7B-0924-Base
Card metadata:
base_model: 1024m/OLMoE-1B-7B-0924-Base
library_name: peft
pipeline_tag: text-generation
license: apache-2.0
tags: dpo, dora, qlora, lora, olmoe, alignment, preference-learning, transformers, trl, peft
datasets: teknium/OpenHermes-2.5, HuggingFaceH4/ultrafeedback_binarized
language: en