Model: demonlxrd/olmoe-openhermes-ultrafeedback-dora-dpo
Author: demonlxrd
Pipeline: text-generation
Library: peft
Tags: peft, safetensors, dpo, dora, qlora, lora, olmoe, alignment, preference-learning, transformers, trl, text-generation, conversational, en, dataset:teknium/OpenHermes-2.5, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:1024m/OLMoE-1B-7B-0924-Base, base_model:adapter:1024m/OLMoE-1B-7B-0924-Base, license:apache-2.0, region:us
Base models (adapter): id: 1024m/OLMoE-1B-7B-0924-Base
Card metadata: base_model: 1024m/OLMoE-1B-7B-0924-Base
library_name: peft
pipeline_tag: text-generation
license: apache-2.0
tags: dpo, dora, qlora, lora, olmoe, alignment, preference-learning, transformers, trl, peft
datasets: teknium/OpenHermes-2.5, HuggingFaceH4/ultrafeedback_binarized
language: en
Likes: 1 | All-time downloads: 43
Created: 2025-11-08 05:06:11