Jia wei

SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization

SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration

SageAttention3: Microscaling FP4 Attention for Inference and An Exploration of 8-Bit Training

SpargeAttention: Accurate and Training-free Sparse Attention Accelerating Any Model Inference