Zhenyu Zhang

CARE: Covariance-Aware and Rank-Enhanced Decomposition for Enabling Multi-Head Latent Attention

Understanding and Steering the Cognitive Behaviors of Reasoning Models at Test-Time

Why RL Updates Look Sparse: An Implicit Compass Drives Optimization Bias

LLMs Can Get "Brain Rot"!

Fantastic Reasoning Behaviors and Where to Find Them: Unsupervised Discovery of the Reasoning Process

Stable-SPAM: How to Stably Train Large Language Models in 4-Bit

Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More

On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention for Long-Context LLM Serving

SEAL: Steerable Reasoning Calibration of Large Language Models for Free

R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference

Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients

From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients