Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
allenai
/
OLMoE-1B-7B-0924
like
108
Follow
Ai2
1,445
Text Generation
Transformers
Safetensors
allenai/OLMoE-mix-0924
English
olmoe
Mixture of Experts
olmo
Carbon Emissions
Inference Endpoints
arxiv:
2409.02060
License:
apache-2.0
Model card
Files
Files and versions
Community
3
Train
Deploy
Use this model
c1b31da
OLMoE-1B-7B-0924
/
model-00001-of-00003.safetensors
Commit History
Move anneal branch to main
f8770d2
Muennighoff
commited on
Aug 13
fp32 -> bf16; step1200000
feed7e7
Muennighoff
commited on
Jul 24