Hugging Face model: allenai/StdMoE_1b14b_1T_Preanneal
Author: allenai
Created: 2026-05-05 00:28:32
Last modified: 2026-07-09 00:43:56
Pipeline: text-generation
Library: transformers
Likes: 5 | Downloads: 220
Tags: transformers, safetensors, emo, text-generation, moe, mixture-of-experts, baseline, pre-annealing, conversational, custom_code, en, dataset:allenai/OLMoE-mix-0924, arxiv:2605.06663, license:apache-2.0, region:us
Card metadata:
license: apache-2.0
language: en
library_name: transformers
pipeline_tag: text-generation
tags: moe, mixture-of-experts, baseline, pre-annealing
datasets: allenai/OLMoE-mix-0924