The language models of the paper "Kronecker Delta Rule for Long Context Linear Attention" pretrained on 100B tokens.
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
Kronecker Delta Rule for Long Context Linear Attention
KVpop -- Key-Value Cache Compression with Predictive Online Pruning