view post Post 2180 Reply Native tensor parallel has landed in transformers!!! https://github.com/huggingface/transformers/pull/34184 thanks a lot to the torch team for their support! Contributions are welcome to support more models! š„
view post Post Reply mamba is now available in transformers. Thanks to @tridao and @albertgu for this brilliant model! š and the amazing mamba-ssm kernels powering this!Checkout the collection here: state-spaces/transformers-compatible-mamba-65e7b40ab87e5297e45ae406
Mamba Mamba checkpoints compatible with transformers ArthurZ/mamba-2.8b Text Generation ā¢ Updated Mar 4 ā¢ 15 ā¢ 1 ArthurZ/mamba-2.8b-slimpj Text Generation ā¢ Updated Feb 19 ā¢ 20 ArthurZ/mamba-1.4b Text Generation ā¢ Updated Feb 29 ā¢ 19 ArthurZ/mamba-790m Text Generation ā¢ Updated Feb 29 ā¢ 11