Golnoosh Samei

Coverage-Driven KV Cache Eviction for Efficient and Improved Inference of LLM

ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models