Tingfeng Lan

Scorpio: Serving the Right Requests at the Right Time for Heterogeneous SLOs in LLM Inference

Efficient and Workload-Aware LLM Serving via Runtime Layer Swapping and KV Cache Resizing

Scorpio: Serving the Right Requests at the Right Time for Heterogeneous SLOs in LLM Inference