Junxiong Wang

Understanding and Improving Length Generalization in Hierarchical Sparse Attention Models

CARE: Covariance-Aware and Rank-Enhanced Decomposition for Enabling Multi-Head Latent Attention

Overfill: Two-Stage Models for Efficient Language Model Decoding