Low Rank Sparse Attention
Collection
Open source weights of Lorsa modules introduced in "Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition". • 3 items • Updated • 4
Jiaxing Wu
crabshellman
·
AI & ML interests
Mechanistic Interpretability
Recent Activity
liked a model about 6 hours ago
nex-agi/Nex-N2.5-Pro liked a model 7 months ago
OpenMOSS-Team/MOVA-360p liked a model 7 months ago
OpenMOSS-Team/MOSS-TTSOrganizations
None yet
upvoted a collection over 1 year ago