Kai-Chiang Wu

UniQL: Unified Quantization and Low-rank Compression for Adaptive Edge LLMs

xKV: Cross-Layer KV-Cache Compression via Aligned Singular Vector Extraction

Speculate Deep and Accurate: Lossless and Training-Free Acceleration for Offloaded LLMs via Substitute Speculative Decoding

Quamba: A Post-Training Quantization Recipe for Selective State Space Models

Quamba2: A Robust and Scalable Post-training Quantization Framework for Selective State Space Models

Palu: KV-Cache Compression with Low-Rank Projection