Hugging Face model: tencent/HiLS-Attention-7B
Author: tencent
Created: 2026-07-09 03:38:58
Last modified: 2026-07-27 08:55:39
Pipeline: text-generation
Library: transformers
Likes: 22 | Downloads: 680
Tags: transformers, safetensors, olmo_hils, text-generation, long-context, sparse-attention, efficient-attention, pretraining, olmo3, hils-attention, en, arxiv:2607.02980, base_model:allenai/Olmo-3-1025-7B, base_model:finetune:allenai/Olmo-3-1025-7B, license:apache-2.0, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: allenai/Olmo-3-1025-7B
Card metadata:
license: apache-2.0
base_model: allenai/Olmo-3-1025-7B
language: en
library_name: transformers
tags: long-context, sparse-attention, efficient-attention, pretraining, olmo3, hils-attention
arxiv: 2607.0298