Surin Ahn

MMInference: Accelerating Pre-filling for Long-Context Visual Language Models via Modality-Aware Permutation Sparse Attention

SCBench: A KV Cache-Centric Analysis of Long-Context Methods

SecurityLingua: Efficient Defense of LLM Jailbreak Attacks via Security-Aware Prompt Compression

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention