SSA
Collection
Models and Datasets of paper: [Simplified Sparse Attention via Gist Tokens] • 30 items • Updated
GSA-FT-Qwen2-7B-Instruct-chunk16
This model is fine-tuned from gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk16 using Gist Sparse Attention (GSA) with chunk size chunk16.
Paper
GSA: Gist Sparse Attention via Learnable Compression and Selective Unfolding
Model Details
| Field | Value |
|---|---|
| Base model | gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk16 |
| Training type | Supervised Fine-Tuning |
| Chunk size | chunk16 |
| Architecture | Qwen2-7B |
- Downloads last month
- 51
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk16
Base model
Qwen/Qwen2-7B Finetuned
Qwen/Qwen2-7B-Instruct