Kati8/ICLR_2023_2025 huggingface dataset:
authors: Xunhao Lai
authors: Jianqiao Lu
authors: Yao Luo
authors: Yiyuan Ma
authors: Xun Zhou
reviews: 
Comments: This work investigates the LLM long sequence inference efficiency challenge and proposes a novel and flexible method FlexPrefill to solve it. The proposed FlexPrefill featured with two components: Query-Aware Sparse Pattern Determination and Cumulative-Attention Based Index Selection, of which the former one adaptively optimize the usage of the sparse attensions while the latter one ensures the quality of selected sparse attentions. Extensive experiments elaborate the effectiveness and superiority of FlexPrefill.
Strengths: a) The proposed Query-Aware Sparse Pattern Determination strategy step further on existing work to provide flexibility to sparse attention usage.

b) Promising improvments on extensive experiment compared with SOTA.
Weaknesses: a) Unclear costs analysis of pre-calculation on JS divergence.

b) The baseline selections are insufficient.
Recommendation: 8
Reviewer confidence: 3
Soundness/correctness: 3
Clarity: 3