Model: demonlxrd/olmoe-openhermes-ultrafeedback-dora-dpo-merged
Author: demonlxrd
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, olmoe, text-generation, dpo, dora, qlora, alignment, preference-learning, merged, conversational, en, dataset:teknium/OpenHermes-2.5, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:1024m/OLMoE-1B-7B-0924-Base, base_model:finetune:1024m/OLMoE-1B-7B-0924-Base, license:apache-2.0, endpoints_compatible, region:us
Base models (finetune): id: 1024m/OLMoE-1B-7B-0924-Base
Card metadata: base_model: 1024m/OLMoE-1B-7B-0924-Base
library_name: transformers
pipeline_tag: text-generation
license: apache-2.0
tags: dpo, dora, qlora, olmoe, alignment, preference-learning, merged
datasets: teknium/OpenHermes-2.5, HuggingFaceH4/ultrafeedback_binarized
language: en
Likes: 0 | All-time downloads: 19
Created: 2025-11-08 06:08:07