State Space Models

community

state-spaces

Activity Feed

AI & ML interests

None defined yet.

Recent Activity

tridao authored a paper about 1 month ago

RedPajama: an Open Dataset for Training Large Language Models

tridao authored a paper 4 months ago

The Mamba in the Llama: Distilling and Accelerating Hybrid Models

mamba-checkpoints authored a paper 5 months ago

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

View all activity

state-spaces's activity

tridao

authored a paper about 1 month ago

RedPajama: an Open Dataset for Training Large Language Models

Paper • 2411.12372 • Published Nov 19 • 47

ArthurZ

posted an update about 1 month ago

Post

2673

Native tensor parallel has landed in transformers!!! https://github.com/huggingface/transformers/pull/34184 thanks a lot to the torch team for their support!

Contributions are welcome to support more models! 🔥

tridao

authored a paper 4 months ago

The Mamba in the Llama: Distilling and Accelerating Hybrid Models

Paper • 2408.15237 • Published Aug 27 • 37

mamba-checkpoints

authored a paper 5 months ago

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Paper • 2405.21060 • Published May 31 • 63

albertgu

authored a paper 7 months ago

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Paper • 2405.21060 • Published May 31 • 63

mamba-checkpoints

updated a model 8 months ago

state-spaces/mamba-2.8b

Updated May 11 • 30.1k • 145

ArthurZ

authored a paper 9 months ago

RecurrentGemma: Moving Past Transformers for Efficient Open Language Models

Paper • 2404.07839 • Published Apr 11 • 43

albertgu

authored a paper 10 months ago

Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling

Paper • 2403.03234 • Published Mar 5 • 11

tridao

authored a paper 10 months ago

Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling

Paper • 2403.03234 • Published Mar 5 • 11

ArthurZ

posted an update 10 months ago

Post

mamba is now available in transformers. Thanks to @tridao and @albertgu for this brilliant model! 🚀 and the amazing mamba-ssm kernels powering this!
Checkout the collection here:
state-spaces/transformers-compatible-mamba-65e7b40ab87e5297e45ae406