Jun Zhang

SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration

Train Small, Infer Large: Memory-Efficient LoRA Training for Large Language Models

FloE: On-the-Fly MoE Inference on Memory-constrained GPU