Hugging Face model: momoketchum/nanoMoE
Author: momoketchum
Created: 2026-08-01 03:26:34
Last modified: 2026-08-01 04:11:17
Pipeline: text-generation
Library: pytorch
Likes: 0 | Downloads: 18
Tags: pytorch, safetensors, nanomoe, mixture-of-experts, mla, swiglu, rope, text-generation, en, dataset:HuggingFaceFW/fineweb-edu, license:mit, region:us
Card metadata:
license: mit
library_name: pytorch
tags: mixture-of-experts, mla, swiglu, rope, pytorch, text-generation
datasets: HuggingFaceFW/fineweb-edu
language: en
pipeline_tag: text-generation