Shiyao Li

PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs

Mixture of Attention Spans: Optimizing LLM Inference Efficiency with Heterogeneous Sliding-Window Lengths

LV-Eval: A Balanced Long-Context Benchmark with 5 Length Levels Up to 256K

ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation

MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression