Yixiao Li

On the Efficiency of Structured Pruning in Small Language Model Pretraining

NoWag: A Unified Framework for Shape Preserving Com- pression of Large Language Models

Deep Reinforcement Learning from Hierarchical Preference Design

Fantastic Experts and How to Find Them: A Multi-Dimensional Study for Experts-Level Sparsification in Mixture-of-Experts