Weizhong Huang

RoPK: A Head-Level Key Cache Channel Pruning Method for Efficient Long-Context LLM Inference

Determining Layer-wise Sparsity for Large Language Models Through a Theoretical Perspective

Discovering Important Experts for Mixture-of-Experts Models Pruning Through a Theoretical Perspective

Dynamic Low-Rank Sparse Adaptation for Large Language Models

Mitigating Gradient Interference for Efficient Sparse Fine-Tuning of Large Language Models

Towards Efficient Automatic Self-Pruning of Large Language Models