Yang Zhao

Occult: Optimizing Collaborative Communications across Experts for Accelerated Parallel MoE Training and Inference

RoSTE: An Efficient Quantization-Aware Supervised Fine-Tuning Approach for Large Language Models