Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Tasks
Paper
•
2402.04248
•
Published
•
30
mamba
-
-
Scavenging Hyena: Distilling Transformers into Long Convolution Models
Paper • 2401.17574 • Published • 15 -
Scalable Autoregressive Image Generation with Mamba
Paper • 2408.12245 • Published • 25 -
Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
Paper • 2408.12570 • Published • 30 -
SambaMixer: State of Health Prediction of Li-ion Batteries using Mamba State Space Models
Paper • 2411.00233 • Published • 7 -
Hymba: A Hybrid-head Architecture for Small Language Models
Paper • 2411.13676 • Published • 38 -
Gated Delta Networks: Improving Mamba2 with Delta Rule
Paper • 2412.06464 • Published • 9