Pengle Zhang

SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization

SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration

SageAttention3: Microscaling FP4 Attention for Inference and An Exploration of 8-Bit Training

InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory