Ting Hu

E$^3$-Pruner: Towards Efficient, Economical, and Effective Layer Pruning for Large Language Models

MoESD: Unveil Speculative Decoding's Potential for Accelerating Sparse MoE

FastAttention: Extend FlashAttention2 to NPUs and Low-resource GPUs for Efficient Inference