Hugging Face model: AlexWortega/moe-600m-qwen3-upcycle
Author: AlexWortega
Created: 2026-07-21 19:52:53
Last modified: 2026-07-29 13:15:15
Library: pytorch
Likes: 1 | Downloads: 788
Tags: pytorch, safetensors, moe, mixture-of-experts, upcycling, qwen3, pretraining, en, dataset:openbmb/Ultra-FineWeb, base_model:Qwen/Qwen3-0.6B-Base, base_model:finetune:Qwen/Qwen3-0.6B-Base, license:apache-2.0, region:us
Base model relation: finetune
Base models: id: Qwen/Qwen3-0.6B-Base
Card metadata:
license: apache-2.0
language: en
library_name: pytorch
tags: moe, mixture-of-experts, upcycling, qwen3, pretraining
datasets: openbmb/Ultra-FineWeb
base_model: Qwen/Qwen3-0.6B-Base