Hugging Face model: mikecovlee/tinymixtral
Author: mikecovlee
Created: 2026-07-21 12:42:28
Last modified: 2026-07-31 08:44:03
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 996
Tags: transformers, pytorch, tinymixtral, text-generation, moe, mixture-of-experts, small-model, pretraining, from-scratch, conversational, custom_code, dataset:HuggingFaceFW/fineweb-edu, dataset:HuggingFaceTB/smollm-corpus, dataset:wikimedia/wikipedia, license:mit, region:us
Card metadata:
license: mit
datasets: HuggingFaceFW/fineweb-edu, HuggingFaceTB/smollm-corpus, wikimedia/wikipedia
pipeline_tag: text-generation
library_name: transformers
tags: moe, mixture-of-experts, small-model, pretraining, from-scratch