Ping Li

CaliDrop: KV Cache Compression with Query-based Calibration

RA-SpaRC: Robust Adaptation with Sparse Plus Low-Rank Compressors

Adaptive Dual-Granularity Pruning Method for Large Language Models

Semantic-aware Pruning of Large Language Models via Neuron Importance Explanation

Adapprox: Memory Efficient Optimization via Adaptive Randomized Low-Rank Approximation

Beware of Calibration Data for Pruning Large Language Models

FISTAPruner: Layer-wise Post-training Pruning for Large Language Models

SinkQ: Accurate 2-bit KV Cache Quantization with Dynamic Sink Tracking

FASP: Fast and Accurate Structured Pruning of Large Language Models