Hugging Face model: demonlxrd/olmoe-openhermes-ultrafeedback-dora-dpo-merged
Author: demonlxrd
Created: 2025-11-08 06:08:07
Last modified: 2025-11-08 06:08:55
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 6
Tags: transformers, safetensors, olmoe, text-generation, dpo, dora, qlora, alignment, preference-learning, merged, conversational, en, dataset:teknium/OpenHermes-2.5, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:1024m/OLMoE-1B-7B-0924-Base, base_model:finetune:1024m/OLMoE-1B-7B-0924-Base, license:apache-2.0, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: 1024m/OLMoE-1B-7B-0924-Base
Card metadata:
base_model: 1024m/OLMoE-1B-7B-0924-Base
library_name: transformers
pipeline_tag: text-generation
license: apache-2.0
tags: dpo, dora, qlora, olmoe, alignment, preference-learning, merged
datasets: teknium/OpenHermes-2.5, HuggingFaceH4/ultrafeedback_binarized
language: en