XAttention: Block Sparse Attention with Antidiagonal Scoring
Paper
•
2503.16428
•
Published
•
12
Guangxuan Xiao
Guangxuan-Xiao
AI & ML interests
Efficient Machine Learning
Recent Activity
upvoted
a
paper
12 days ago
XAttention: Block Sparse Attention with Antidiagonal Scoring
upvoted
a
collection
24 days ago
🧠Reasoning datasets
authored
a paper
about 1 month ago
LServe: Efficient Long-sequence LLM Serving with Unified Sparse
Attention
Organizations
Guangxuan-Xiao's activity
upvoted
a
paper
12 days ago
upvoted
a
collection
24 days ago
authored
a
paper
about 1 month ago
authored
a
paper
6 months ago
upvoted
a
paper
6 months ago
commented
a
paper
6 months ago
updated
2
models
6 months ago
authored
5
papers
8 months ago
Offsite-Tuning: Transfer Learning without Full Model
Paper
•
2302.04870
•
Published
Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
Paper
•
2406.10774
•
Published
•
3
QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
Paper
•
2405.04532
•
Published
Retrieval Head Mechanistically Explains Long-Context Factuality
Paper
•
2404.15574
•
Published
•
3
InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory
Paper
•
2402.04617
•
Published
•
4
updated
a
model
8 months ago
updated
a
model
9 months ago
updated
a
dataset
9 months ago
updated
a
model
about 1 year ago
liked
a
model
about 1 year ago
authored
a
paper
about 1 year ago
updated
a
model
over 1 year ago