Space: visv-Bro/repro-multi-head-attention-as-a-source-of-catastrophic-forgetting-in-moe-transformers
title: Reproduction: Multi-Head Attention as a Source of Catastrophic Forgetting in MoE Transformers
sdk: static
tags: trackio, trackio-logbook, open-experiment, icml2026-repro, paper-iXhFXwIbvi
Tags: static, trackio, trackio-logbook, open-experiment, icml2026-repro, paper-iXhFXwIbvi, region:us