|
--- |
|
language: en |
|
license: mit |
|
tags: |
|
- atc |
|
--- |
|
|
|
# Fine-Tuned Agglomerative Token Clustering - DeiT-Tiny-Average - NUS-WIDE |
|
|
|
### Model Details |
|
Agglomerative Token Clustering (ATC), a novel hierarchical hard-merging based token reduction method. |
|
|
|
- **Developed by:** Joakim Bruslund Haurum, Sergio Escalera, Graham W. Taylor, and Thomas B. Moeslund |
|
- **Model type:** Vision Transformer |
|
- **License:** MIT |
|
- **Task:** Image Classification |
|
|
|
### Model Card |
|
- **Backbone:** DeiT-Tiny |
|
- **Token Reduction Method:** ATC |
|
- **Linkage Function:** Average |
|
- **Reduction Ratio:** {0.25, 0.5, 0.7, 0.9} |
|
- **Reduction Stages:** 3, 6, 9 |
|
|
|
### More Resources |
|
- **Repository:** [https://github.com/JoakimHaurum/ATC](https://github.com/JoakimHaurum/ATC) |
|
- **Paper:** [https://arxiv.org/abs/2409.11923](https://arxiv.org/abs/2409.11923) |
|
- **Project Page:** [https://vap.aau.dk/atc](https://vap.aau.dk/atc) |
|
- **HuggingFace Collection:** [https://huggingface.co/collections/joakimbh/agglomerative-token-clustering-66e94dfb313e85ec97590fe4](https://huggingface.co/collections/joakimbh/agglomerative-token-clustering-66e94dfb313e85ec97590fe4) |
|
|
|
### Use |
|
The model files contain both standard and EMA model parameters. The version which gave the best performance is indicated with the "ema_best" boolean. |
|
|
