metadata

license: mit

GroupMamba-Small Model Card

Model Details

GroupMamba-Small is a generic backbone with 34M parameters trained on the ImageNet-1K dataset for vision tasks.

Model type: Parameter-Efficient and Accurate Vision Backbone Based on Group Visual State Space Model
License: Non-commercial license

Model Sources

Repository: https://github.com/amshaker/GroupMamba
Paper: https://arxiv.org/abs/X.X

Uses

The primary use of GroupMamba is research on vision tasks, e.g., classification, segmentation, detection, and instance segmentation, with an SSM-based backbone. The primary intended users of the model are researchers and hobbyists in computer vision, machine learning, and artificial intelligence.

How to Get Started with the Model

You can replace the backbone for vision tasks with the proposed GroupMamba: https://github.com/Amshaker/GroupMamba/blob/main/classification/models/groupmamba.py
Then you can load this checkpoint and start fine-tuning.

Training Details

GroupMamba is pretrained on ImageNet-1K with classification supervision. The training data is around 1.3M images from ImageNet-1K dataset. See more details in this [paper](https://arxiv.org/abs/X.X.

Evaluation

GroupMamba-Small is evaluated on ImageNet-1K val set, and achieves 83.9% Top-1 Acc with only 34M parameters. See more details in this paper.

Additional Information

Citation Information

@article{GroupMamba,
  title={GroupMamba: Parameter-Efficient and Accurate Group Visual State Space Model},
  author={Abdelrahman Shaker and Syed Talal Wasim and Salman Khan and Gall Jürgen and Fahad Khan},
  journal={arXiv preprint arXiv:X.X},
  year={2024}
}