Boju Chen

Mixture of Attention Spans: Optimizing LLM Inference Efficiency with Heterogeneous Sliding-Window Lengths

MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression

SemSA: Semantic Sparse Attention is hidden in Large Language Models.