DaYou Du

SeerAttention: Self-distilled Attention Gating for Efficient Long-context Prefilling

STBLLM: Breaking the 1-Bit Barrier with Structured Binary LLMs

SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs