Cong Xie

Cautious Weight Decay

PrunedLoRA: Robust Gradient-Based Structured Pruning for Low-rank Adaptation in Fine-tuning

Truncated Proximal Policy Optimization

DUO: No Compromise to Accuracy Degradation

MoE-Pruner: Pruning Mixture-of-Experts Large Language Model using the Hints from Its Router