Hugging Face model: Mati83moni/HybridMoE-Titan-v1
Author: Mati83moni
Created: 2026-06-12 23:27:27
Last modified: 2026-06-13 22:42:33
Pipeline: text-generation
Library: pytorch
Likes: 0 | Downloads: 0
Tags: pytorch, mixture-of-experts, mamba, ssm, hybrid-architecture, language-model, decoder-only, rope, pretrained, from-scratch, independent-research, text-generation, en, pl, dataset:Mati83moni/HybridMoE-Training-Dataset-v1, arxiv:2403.19887, arxiv:2405.16712, arxiv:2401.06066, arxiv:2312.00752, doi:10.57967/hf/9141, license:mit, model-index, region:us
Card metadata:
language: en, pl
license: mit
tags: pytorch, mixture-of-experts, mamba, ssm, hybrid-architecture, language-model, decoder-only, rope, pretrained, from-scratch, independent-research
pipeline_tag: text-generation
library_name: pytorch
datasets: Mati83moni/HybridMoE-Training-Dataset-v1